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ABSTRACT 

This volume represents a variety of current efforts 
to incorporate thought-provoking methods into teaching. There are 
three sections. "Curriculum Developments" defines key qurricular 
terns and offers a framework anA general examples of teaching 
tactics. In this section, Bart>ara Presaeisen distinguishes thinking 
from other cognitive activities and shows how "conation" (motivation 
and striving) and knowledge representation are being i^sed to promote 
thinking. Robert Marzamo discusses three doiha4,ns (learning to learn, 
content thinking, and reasoning) assignable' to specif -ifc; subjects, and 
Francis Schrag describes how to promote dee^ thinking in the 
classroom. "Teaching and Assessment" descrit^s View methods for 
teaching thinking and assessing student process. BaraX Rosenshine 
and Joseph Guenther describe "scaffolding" iemjferairy i^struct4onal 
supports), and Ann Brown and Joseph Campione'i^-ge incorporation of 
thinking into all school programs through "recSiprocal teUch.^f.g" 
strategies. Charles Letteri's essay focuses on assessing Students' 
learning strengths and weaknesses as a diagnostic tool fq^r~guiding 
individualized and group programs to improve classroom peafformance. 
Robert Ennis discusses several tests auid techniques for measuring 
thinking for accountability. "Concluding Perspectives" syatheslzes 
research on practical methods of teaching tjiinking in esS^S' 
contributed by Barry Beyer, Robert Sternb4r^ 'and James Kef fe." Most 
Chapters contain reading suggestions. (MLH) ' ■ , 
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Teaching for thinking is both an ideal and a goal. As an ideal, it has 
been at the forefiront of many educational reform efforts of the past 
century. As a gcml, it has been an elusive destination, pursued more often 
by goiKi intentions and impractical theories than by «irorkable programs. 
Some of this is beginning to change. 

In the past decade, philosophers, psychologists, and ^ucational practi- 
tioners have all come to agree on the importance of effective thinking to 
success in school and in life. Creative models and programs have prolifer- 
ated. A movement has materialized. We are now at the crest of a scholar- 
ly and pubhc policy wave of approval for the efficacy of good thinking. Vir- 
tually everyone acknowledges the modem information explosion and 
proposes that we teach for effective thinking. The questions remain about 
who, what, when, and how- 

The distinguished authors of this book propose some sensible answers 
to these questions. Not all questions are resolved, but the issues are laid 
out and clarified A matrix is proposed for thinking about thinking. 
We invite your thoughtful reading and reflection. 



James W. Keefe 

Director of Research, NASSP 
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The three words in the title of this book are carefully cho^a. In plan- 
ning the volume, we intended to represent a variety of current efforts 
to incorporate thought- provoking methods i mto teaching. Our further 
hope was to convey contemiX)rary ideas, appr caches, and programs, in a 
set of crisply written chapters. 

Many policy makers and educators believe that it is important to 
emphasize thinking in today*s schools. The National Assessment of 
Educational Progress and other testing programs suggest that students 
have improved their rates of knowledge acquisition in the last decade. 
They are lagging, however, in the **higher thinking skills'* such as anal- 
ysis, sjndthesis, problem solving, and applications. Comparisons of U.S. 
students with those in other nations, moreover, show that they lag 
more on higher than lower order skills (Walt)erg, 1983, 1988). 

None of this is to say that we can put knowledge aside. Facts and ideas 
go together; it is hard to find an expert thinker in any field who lacks 
knowledge. If we gave priority to thinking alone, then a course in logic or 
even a programraed computer might suffice — ^but they obviously do not. 
Students need knowledge to think about. 

But neither can facts alone suffice. Thinking is important, even at 
the outset in acquiring new knowledge. Thought is required, for exam- 
ple^ in deciding what knowledge to pursue. Psychological research sug- 
gests that student thoughtfulness promotes learning efficiency. Stu- 
dents benefit from explicit teaching about how to set their own learning 
goals and how to monitor their progress. Reflection about knowledge 
and ideas can lead to insights that improve long-term retention and 
problem solving. 

How can such ideas be translated into curricula and instructional 
activities? The following overview provides capsule summaries and high- 
lights of the chapters. 

Overview 

The chapters are divided into three sections: Ciariculum Developments 
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defines key curricular terms and offers a framework and general 
examples of teadiing tactics. Teaching and Assessment describes new 
methods for teaching thinking and ass^sing the d^^ree to which it has 
been accomplished. Concluding Perspectives synthesizes research and 
practical methods of teaching thinking and axialyzes the a>ntributions of 
this book. Some specific (xmtributiims of each chapter are as follows : 

CmTiculum I>evelopmeiits 

Barbara Presseisen distinguishes thinking from thinking about thinking 
C*meta-cc^nition''), learners* awareness, and regulation of their thinking. 
She also describes ''conation'' (motivation and striving) and knowl^ge 
representation and shows how these ideas are being incorporated in 
curricula to promote thinking. 

Robert Marzano begins with a conceptual framework and tactics for 
thinking. He divides 22 tactics into three domains — learning to learn, 
content thinking, and reasoning — which, as he illustrates, can be appro- 
priately assigned to subjects at specific grade levels. 

Francis Schrag ai^aes that to teach thinking is to create a disposition 
rather than to impart a formula, and that deep thinking is specific to the 
subject matter. He describes several ways to promote such classroom 
thoughtfulness. 

Inching and Assessment 

Barak Rosenshine and Joseph Guenther describe "scaflblding," temporary 
instructional supports for students to bridge the gap between their 
abilities and their goals. Research supports six major elements of 
scafiblding, ranging from preinstructional activities to applications to new 
examples. 

Ann Brown and Joseph Campione argue that thinking must be incor- 
porated in all school programs, even for the yoimgest children and those 
at risk. Their research-based programs illustrate "reciprocal teaching,'' 
which encourages thinking by organized cooperative discussions in read- 
ing, writing, and science. 

Charles Lfetteri describes a means of assessing students' learning 
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strengths and weaknesses. He shows how such diagnostic information 
can guide individualized and group programs of instruction to improve 
classroom performance. 

Robert Ennis argues that one way to encourage thinking is to assess 
it, since students are guided by recognition and feedback. His goal is 
"^asonable reflective thinking focused on what to believe or do.^ He dis- 
cusses several tests and techniques for measuring thinking for accoimt- 
abihty. 

Concluding Perspectives 

Barry Beyer synthesizes current scholarship and practice under several 
components: a thou^tful leamii^ environment, teaching thinking skills, 
direct instruction in skills teaching, teacher modeling, and integration of 
these components in all m^or subjects. He defines and illustrates each of 
these. 

Robert Sternberg argues that thoughtful schools require thoughtful 
principals, teachers, and students. He shows how principals employ "the 
thinking cycle,'' consisting of problem recognition and definition, resound 
allocation, plan formulation, implementation, monitoring, and fine-tuning 
or revision. 

James Keefe provides an analytic framework in the last chapter. It 
offers a continuimi on which to classify and organize the approaches and 
serves as a conceptual matrix of what they contain. 

Conclusion 

Educators will find a wealth of ideas in these chapters. They have been 
chosen to represent a variety of philosophies and techniques. Given their 
personal viewpoints and settings, educators may indeed wish to seek a 
balance among these views. The matrix in James Keefe's chapter is a 
good starting place for pursuing this balance. 

A final point about balance may serve to conclude tliis overview, Edu- 
cators must strike a balance of knowledge and thought; they must seek 
other balances as well. Cognition itself must be balanced against emo- 
tion and behavior. As Plato declared, three horses pull the psychological 
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chariot: feelings, thot^ts, and behavior. Letting one element get too far 
ahead or headed in the wrong direction can upset the chariot — and skew 
the thinking curriculiun. 
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Thinking Skills in the Curriculum 

Barfnira Z. Presseisen 

It is not siirprising that a period of school reform includes a critical 
examination of the cmriculum, as weU as a review of practices in both 
instruction and assessment Thus, the current movement to ^Vratnicture*" 
American education is considering a variety of ways to organize what is 
learned at school, who m^kes such decisions, for what purposes and 
objectives, and under what kinds of a)nditions and ccmstraints. 

The last decade of the twentieth century is also marked by renewed 
interest in a social-c(^nitive approach to teaching and learning. Resting 
on a research base in htmian development and drawing on the e:splo$ion 
of knowledge in an information age, a focus on developing higher order 
thought processes has made the teaching of thinking throughout the 
schooFs curriculum a viable option for restmctured schwUng (Presseisen, 
1987; Presseisen et al., 1990; Resnick and Klopfer, 1989). Prom all indica- 
tions, this option is likely to persist aud to influence classrooms in both 
critical and creative ways well into the 1990s- 

What does such an approach mean to educators in the nation's sec- 
ondary schools? What implications does it hold for the ways they orga- 
nize student learning and assignments, for their conception of knowl- 
edge itself^ Indeed, what might a thinking curriculum imply for both 
teachers and students in the academic as well as the work world of the 
21st centiuy? 



Historical Perspective 

For nearly 75 years, curriculum in American schools, and particularly its 
high schools, has largely been an accumulation of significant facts 
intricately woven into a tapestry of scholastic linguistics. The knowledge 
of most worth" pursued in the nation's classrooms — even without a 
formalized national curriculum— has long involved a cx>mmon vocabulary 
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of academic labels: ^pe and sequence, subject-by-subject ^llabi, course 
requirements, and discrete departmental subj^ matters usually defined 
by course textbooks or a state's general standards and regulations. 

Under these circumstances, teaching has most often involved "telUng" 
and ''coverage," follow^ by a testing or assessment exj^rience. In some 
ways, the ciuriculum of the most recent past in American education has 
been a "cull;ural heritage'' amalgam. 

In contrast, over tibe last decade, the movement to make the curriculum 
more thoughtful and the students more strategic problem solvers has 
passed throu^ a series change that has gradually influenced particular 
subject matters in a fairly common way. Writing across the curriculimi 
highUght^ the fact that active minds need to produce lii^uistic knowl^ige 
and not merely memorii^ it The new guidelines in mathematics education 
stress problem solving and understandinig the strat^es of mathematical 
thought developmrait. The nKiiscovery of the richness of literature reveals 
new forms of literacy for imderstandii^ how cultures connect writers and 
(x^ntexts. Science teaching is intrigued by the questions that scientists ask 
as well as by the formation of viaMe proUems. 

Subject-specific thinkers have been encouraged to focus on question- 
ing protocols, and not merely on finding elusive answers to static situa- 
tions that are guaranteed to chan^, A new-found aesthetic calls not only 
for a} predating the various graphic and plastic arts, but also for gener- 
ating the discriminations and nuance-finding abilities required by criti- 
cal evaluation- Finally, in a globally interdependent and technologically 
romplex society, human understanding calls out for critical examination 
and culturally diverse ways of depicting reality that were once the 
province of a much simpler, and probably naive, ^social studies,*" 

In one sense, a whole new mindset has grown up around the nation's 
curricula- A different understanding about how students leam and acquire 
knowledge has gradually berome accepted. Much of what transpires in 
educational practice can be imderstood more easily within the context of 
discovering what teaching for thinking means in the school's ciuriculum. 

Comprehending the ThinkiBg Curriculum 

^Thinking skills" in the curriculum is probably a misnomer. An emphasis 
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on acquiring discrete thinking skills could imply that thoughtfUlness can 
be broken down into little bits of information which are merely aggr^ted 
to generate knowledge. In contrast, most of the current cognitive 
educational movement stresses building coxm^:tions, having insights, and 
grasping intuitions that suggest knowledge is built in very different, 
nonreductionist ways. 

Hi^er order thinking — ^the objective that drives many of the programs 
in this movement — includes processes or operations that are emergent 
over the long haul and require active, repeated interactions among the 
learner, the content, and the various learning experiences in school- 
Indeed, there are at least four distinctLve asp^rts that we shoiild examine 
in order to clarify v^eaching for thinking in the overall curriculimi- 

Central to the teaching of thinking is what is meant by cognition itself. 
Thinking is gt^nerally assxmied to be a cognitive process or set of process- 
es, mental actc by which long-term knowledge is acquired and remem- 
bered. Some scholars suggest that cognition actually is composed of mtil- 
tiple building blocks: perception, attention, learning, memory, reasoning, 
language, and emotion- 
Much of the current educational movement concentrates on teaching 
reasoning ability to developing learners, especially the analytic qualities 
of critical thinking. There is also renewed interest in the development of 
memory and a concern with perceptual skills, spurred on by advances in 
video representation and computerized technology. At the same time, a 
fascination with the braiB and its neural organization has opened addi- 
tional elements of ojgnition and raised different research questions, such 
as Gardner's (Gardner and Hatch, 1989) queries into the dimensions of 
multiple intelligence. Potentially, cogxxition can introduce many exciting 
and innovative notions to cuiriculum development, 

A second distinguishable aspect of thinking in the curriculum is a 
focus on metacognition, the learner's knowledge or awareness of his or 
her own cognitive processes and products and the ability to regulate 
them (feedback). In the current movement to place thinking at the heart 
of particular curricula, much has been emphasized that is metaojgnitive 
(executive skiU-based). 

In learning to think, the learner recognizes that he or she must deal 
with two kinds of knowledge: that which involves the learner as a doer of 
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the thinking and the one ultimately responsible for it; an4 that Whiehr ^ . 
involves managing the processes -^f understanding a particular ^aste^^ 
how it is organized, and what significance it has for resolving «pecifici''^r-"^ 
real problema Metacognition in tli^ curriculum deals with bot^ selfHU^-^/-.^ ; ' 
agement and strat^c, siibstantive operations. " . ^* V ^ 

A third distinguishable aspect of feaehing for thinking in title curricu- . 
lum concentrates on conation^ the motivational striving o^attempting to ^ ; 
do something directly with a learning experience. The motivational qt, ^ 
attitudinal aspects of tehavior, including various disposijtions, su^^ 
that motivated thinkere may be inclined tc develop and use practices. 
When learners are curious about their work, when tasks seem relevant to 
a personal o^ntext, or when problems translate to the real world of the 
student — even beyond the school or classnK>m— learning is more likely to 
occur. By contrast, research sugg^rts that if such motivation is missing, 
even the best curriculur : will probatdy fiiil. 

And Anally, the fourth aspect of teaching for thinking in tlje curricu- 
lum includes epistemological considerations — the nature of ^ subject 
content itself— 'low particular subject structures influence what is 
learned, the ways knowledge is characterized, the methocte iei^sociated 
with defining and generating intent, and the kinds of recOT^ or prod- 
ucts with which students must be familiar to build a conceptuttbase. 

Academic content has been the focus of curriculum development 
throughout the long history of schooling. What seems to be different 
about content at the end of the twentieth ceritury is that the subject disci- 
plines are viewed as developmental and in flux themselves. They have 
particular relationships to the other aspects of curricula (cognition, 
metacognition, conation) which must be considered when planning stu- 
dent programs and classroom instruction In fact, the interaction among 
these four aspects of teaching for thinking in the curriculiun is an appro- 
priate focus for examining what is developii^ in curricular implementa- 
tion in the schools. 



New Proiprams and Their Implementation 

At least two kinds of programs present thinking^skills in emei^nt^§chool 
curricula. First, there are those programs that teach thinking in a spe- 
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dalized format or theory, or for particular goals of thmkiiig that they seek 
to develop. Project Impact aims to teach middle or high school students 
the skills of critical thinking and general problem solving. De Bono's 
CoRT program emphasizes the development of creative or lateral tliink- 
ing abiliti^ and seeks applications by youi^sters as well as adults in life- 
in-general circumstances. In idpman's Philosophy for Children, the ran- 
tent area (philosophy) is emphasized no more than the actual reasoning 
skills in student problem-giving activities. 

A second type of thinking program is more typical of the school-devel- 
oped curriculimi, organized arotmd particular subjects or courses, and 
generally rooted in textbooks and teacher manuals develop^ by national 
publishers. In this sea)nd type of pn^ram, teaching for thinking may be 
infused into the scope and sequence of a particular school course, or it 
may be int^rat^ into the content of a basal or subject matter text. 

It is this second type of progran? that is the subject of our discussion. 
Teachers are more likely to use these kinds of materials in their instruc- 
tion at school. These programs usually figure in school-based decision 
making about curriciiliun. Our emphasis does not negate the use ef the 
first kind of thinking program. Valid reasons exist for educators to con- 
sider employing these specialized thinking materials. Research studies 
are available that discuss their successful use (Chance, 1986). 

For an initial experience, however, materials from the second type r i 
program are more likely to be incorporate into teacher training in teach- 
ing for t hinking . It is also possible to examine implementation of the four 
asp^Jts of teaching for thinking *n the curriculum in terms of these mate- 
rials. 

Cognition and the Curriculum 

By far, the most a)mmon cognitive emphasis on teaching for thinking in 
the ciariculum involves determining what are the essential (basic) and 
higher order skills or processes, developing common definitions or mean- 
ings for these several abilities, and helping teachere see that these opera- 
tions are actually embedded in gnxni teaching and sound curricula. 

Marzano et al. (1088), Beyer (1988), and Swartz and Perkins (1989) are 
well-known studies that have stressed this approach. Closely related are 
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added emphases on memory, not merely for purposes of memorization, 
but rather to make information more manageable for the learner. Stu- 
dents are encouraged to master memoiy tedmiques by e nhan rin g verbal 
or visual cues, by increasing voluntary attention and awareness, and by 
being more cognizant of perceptual limitations and constraints in their 
studies. 

Looking at both elementary and secondary textbooks, one can easily 
find examples of various thinking abilities translated into lessons for 
learning science, history, lauguage arts, and mathematics in the class- 
room. These sources relate thinking abiUties to specific subject content- 
Examples of such lessons in current classroom materials include: 

■ Comparing an amoeba and a macrophage in biology for similarities 
and differences (a secondary program). 

■ Predicting the consequences df poor garbage control in a heavily popu- 
lated nei^borhood (an elementary pn^ram). 

■ Analyzing a chart from the World Almanac listing ani mal running 
speeds — finding what are *Hypical" and comparing them to human abil- 
ity and performance (a middle school task). 

■ Following sequential information in a story and being able to summa- 
rize it in a comprehensive way (elementary and secondary programs, 
depending on the complexity of the literature used). 

The various aspect^^ of cognition raise questions about how a curricu- 
lum is organized and presented. One researcher interested in memory 
influences on student learning suggests that education should extend the 
period of time during which students acquire specific (mathematical) 
knowledge. He asks whether the traditional course-per-year in middle/ 
high school mathematics (general mathematics, followed by introductory 
algebra, geometry, and advanced algebra) may actually negatively influ- 
ence the amotmt and quality of mathematics retained by students over 
time. 

Questions may need to be raised about students' familiarity with par- 
ticular knowledge, as well as the appropriateness of tasks assigned in 
actual course instruction. C!ognition in the curriculum gets at the heart of 
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what is to be learned At the same time, it raises issues about how such 
information is acxjuired and what a student's task experience should be 
for the most effective retention, 

Metac»gnition and the Curricalum 

A focus on meta<^gnition in the classroom emphasizes helping students 
imderstand their own responses to thoughtful situations. Quite often, 
metacognition or executive control involves '^hands-on'* learning strate- 
gies to help the learner represent the information more vividly and to 
suggest routes to solutions embedded in fmrticular contents. It presumes 
that direct contact and visual repr^entation <^ depict larger, i^rhaps 
more subtle, issues. In the thinking classroom, tacit understandings of a 
problem situation should be discu^ed, group interaction encoiiraged, and 
learners made aware of the characteristics of the information under 
scrutiny, Metao^nition s^ks to make student learning more explicit and 
the products of classroom e3qperien<^ more memorable. 

A t hinking curriculum that includes metao^nitive skills often empha- 
sizes planning, monitoring, and evaluating behaviors that can gradually 
be taught to students as the particular content is examined. Consider 
these problem-solving strategies, seen from a teacher's perspective, as 
appHed to the learning of science before, during, and after a particular 
classroom experiment. 

■ Before the task 

1, Discuss the nature of the problem being studied. 

2, Ask students questions to help them understand the problem. 

3, Discuss the prior knowledge that students might apply. 

4, Discuss possible solution strat^es, 

■ During the task 

5, Observe and question students, 

6, Give information or limited hints, as needed. 

7, Be sure that students check their answers, strategies. 
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8. Have an extension problem ready for early jBboishers or a more dif- 
ficult task for more able performers. 

■ After the t(xsk 

9. Discuss the various solutions. Ask students to name and describe 
the strategies tibey used 

10. Discuss the extension problems or different tasks. Compare the 
various problems/tasks. 

11. Discuss errors students have made and why they occurred 

12. Discuss possible pitfalls of similar problems and what can be done 
about them. 

13. Have students write similar problems wth new material, differ- 
ent media, or slightly different content. Compare these and have 
students discuss what happens in these variations. 

14. Have students write test questions emplojring similar problems; 
try them. Compare the strategies used and the solutions 
obtain^. Have students keep logs or journals about their obser- 
vations. 

15. Have student groups design related, more complex problems. 

The important role of the teacher as questioner — prodder and elabora- 
tor — emerges from understanding the significance of metacognition in the 
thinking curriculum. How can an instaiictor ena>urage students to clarify 
their ideas, to analyze more deeply, to raise significant, even risky, new 
concepts? How can the teacher stress accuracy and strategic power in the 
learning tasks develop^!? 

The teacher as trusted mediator is a key metacognitive role; the role of 
assessor is diminished. Teaching materials are needed to support con- 
structive interaction and the teacher's new mediational role in the class- 
room. The merging of curricular and instructional tasks is part of this 
approach. 

The thinking classroom that emphasizes metacognition is bent on 
heightened awareness (Prawat, 1989). The larger goal involves aaressing 
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learning strat^es and being able to know and transfer successful prac- 
tices to similar but different problems. Teaching for thinking metacogni- 
tively means helping students learn how to learn, as much as developing 
the cognitive operations themselves. 

Student success at sch<K>l is directly related to **what the students do 
with the information presented . . . what sense they make of it, how they 
relate to what they know and beUeve' (Wittrock, 1987). 

In contrast to traditional curricula, which focus on static, accumulated 
knowledge, the newer published programs emphasize dynamic use and 
active involvement of both students and teachers in the learning task. 

Motivation and the Curriculum 

Whereas cognition and metacognition strive to make the learner more 
skillful, motivation views the developing learner as willful and purpose- 
fill. The **student as worker" metaphor employed in the new curricula of 
the Coalition of Essential Schools mirrors this view. This conception car- 
ries with it Implications for a curriculum that is "authentic.'' Problems 
must ring true to the students, such as a citizenship unit concerned with 
how a person knows when he or she is "^good." 

An authentic curriculum impUes learning relationships that are active 
and, more imjxjrtant, self-regulative. It aarepts the premise that interest- 
ing instruction and well-constructed learning tasks will evoke questions 
firom students, tap natural curiosity, and spark personal eneigy for future 
inquiry. Such a curriculum is designed as an intellectual challenge; the 
problem tasks are forged in a student's long-term involvement with 
essential content, and a gradual building of integrated knowledge. 

Motivation is very much involved with attitudes about learning and 
thinking that are developed over rather long periods of time. How does 
the learner cope with error or failure? How does a teacher guide students 
when they are selecting a weak strategy? Even more significant, is the 
student developing a ^If-concept as a knower of knowledge and a keeper 
of the standards that such academic pursuit entails? The thinking cur- 
riculum calls for the student to direct his or her own thinking as content 
is encountered. 

Motivation raises issues of what it means to become a scientist, a histo- 
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rian, or a writer, and how one performs responsibly along the road from 
novice to expert It may mean that students need to see an event from ^v- 
eral points of view and only slowly learn to value one perspective as more 
valid It may mean that eager workers must learn to curb their impulsivi- 
ty, to hold ba<* judgment imtil additional information is available. It may 
mean that only in retrospect does the learner appreciate a teacher's 
emphasis on greater deliberation and fiirther information gathering. 

The role of teacher as mediator is a key to useful motivation. And the 
curriculum can play an important part by providing learning tasks that 
are intellectually challenging and provocative to curious students. Equal- 
ly important in such a curriculum are problems that encourage the stu- 
dent to reflect or to talk with their peers as they actually work through 
assignments or homework. Socially demanding or a>operative tasks are 
now frequently found in new curricular materials. 

The student who is an autonomous learner is the prime mover of the 
knowledge base. Seeking better information becomes natural to the stu- 
dent. Access to resources, the free exchange of findings, and tmcovering 
and exploring belief systems are part of learning any content. In addi- 
tion, the classroom environment, within which a thinking curriculum is 
explored, is motivational as well as supportive of cognition and metacog- 
nition. InteUectual pursuits are treasured, Resp^ for dijBFering opinions 
is not merely tolerated, but is encouraged 

Singular answers or all-encompassing solutions may be rare. It is their 
pursuit that must be taken seriously by both students and teachers. And 
classroom materials must meet these criteria. Indeed, promoting motiva- 
tion in the thinking curriculxun is a subtle challenge. 

Subject CoBteDt and the Curriexilum 

What are the subjects we study at school? Is the curriculum merely the 
sum of its parts or is it something more significant? Teaching content in 
the thinking oirriculum is concerned with disciplinary, even interdisci- 
plinary, development and change. This aspect of teaching for thinking is 
also mindfiil that formal knowledge is a socially constructed product. 

The auricular challeni^ today is no different than what Socrates faced 
centuries ago: How to bring the findii^ of mature scholars to the minds 
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of young learners and at the same time, to present the materials so that 
students, although limited in their mastery, can be active in their explo- 
ration? 

Transfer is a basic concern of learning in any content area. How can 
the learner apply successful strategies to more than one subj^ matter? 
What is required to make such a match? How can students use the prior 
knowledge they possess in new or novel ymysl How can educators develop 
more integrative curricula, reducing the fragmentation in student i>ro- 
grams? 

Recent projects in science (Project 2(^1), and guidelines for implemen- 
tation of the new secondary mathematics, are beginning to address these 
substantive issues in the curriculum. Other content areas, such as the 
various social sciences, still need to identify a more holistic theme in 
order to build unity in their particular, und^lying disciplines. 

Perhaps some notions about higher order thinking can help these 
deliberations. Consider, for example, the parallel conceptual imderpin- 
nings of history, anthropology, and psychology. How do the processes of 
cognition and metacognitive awareness relate to these basic conceptual 
umderstandings? 

Teaching for thinking, so far as it has developed as a new sfarategy of 
curriculum/instructional reform, has yet to answer even some of the 
most basic epistemological questions. It has imcovered some very inter- 
esting issues that have been relatively untouched since the last spate of 
curriculum reform. 

A great deal still must be done in research and practice. It would 
seem that fostering research about these subtle relationships should be 
an important aspect of teacher education as well as of materials develop- 
ment. Such understandings about content are also likely to affect the 
new ciirriciila, classroom instruction, and student assessment. 

Implicatioiis for Education and Educators 

Teaching for thinking in the curriculiun involves at least four m^'or con- 
cerns for educators: 

1. Thinking skills are not mere add-ons to a curriculum already packed 
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with information and facts. Teaching for thinking is a social-cognitive 
enterprise that must focus on how students learn and acquire knowledge 
across the broad sequence of academic coiurses. 

2. Thinking in a currictilum is a dynamic process that requires students 
to reflect and share with their roUeagues in interactiw ways. Learning to 
think is a social phenomenon that may begin with concrete, hands-on 
learning tasks but gradually should become more self-directed and con- 
ceptual. 

3. Learning to think about a particular curriculum involves a personal 
commitment to scholarly work and to strategies of direct engagement A 
student acquiring new thinking skills must have the motivation to be 
involved and to make successful acts his or her usual performance. 

4. Thinking in a content area reqtiires a holistic, conceptual imderstand- 
- ing of that area and the rules or standards that shape it. Thinking gen- 
erally lies beyond the artificial divisions of curriculum that have charac- 
terized school programs in the past, A thinking curriculum should make 
it easier for students to work flexibly across their several subject mat- 
ters. 

These concerns have not been resolved by American education; rather, 
they have only been realized. Curriculum developers have begun an 
enthusiastic integration of higher order skills into content areas, but 
much remains to be done beyond that 

All fouar aspects of teaching for thinking need attention in educational 
practice. In the final analysis, however, these imderstandings may pro- 
vide a new meaning for curriculum itself. Instead of the repository-of- 
cultural-heritage approach so long the raison d itre of schooling, curricu- 
lum today promises to become a m^or tool of learning. Curriculimi can 
and should enable teachers to invent or transform meanings with stu- 
dents, to confront realities of the world, and to turn them into mindful 
understandings. 

In the words of Piaget, to know something is to invent it. A curricu- 
lum for thinking is a heady invention. 
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A Rationale and Framework for 
Teaching Thinking Tactics 

Robert «7. Marzano 

The notion of teaching tactics for thinking is relatively new, at least as a 
r^ular classroom practice. Fundamentally, teaching th i nking tactics 
involves teaching strategies for performing mental or physical oj^erations 
where a strategy can be imderstood as a general set of rules or stei^ that 
will help you perform a task. Usually there is no strict sequence to the 
steps within a strategy, althoii^ there is a general flow of activity. 

For example, a general strategy exists for reading a book that includes 
such components as looking at the cover, scanning the table of contents, 
scanning the pictures, and so on. Although no one step necessarily must 
be performed before (or after) another, there is a general flow of activity. 

Teaching thinking tactics, then, involves presenting students with gen- 
eral steps to be taken when performii^ s|^cific cognitive operations. The 
notion is gaining considerable momentum becatise of the strength of the 
research findings supporting it- Si^fically, teaching explicit tactics for 
spedflc types of thinking has been shown to dramatically change student 
performance in such areas as reading comprehension, decision making, 
problem solving, writing, and a host of other types of tasks. (For a sum- 
mary of the research on strategy instructions see Derry and Murphy, 
1986, in the list of suggested readings.) 

The fact that strategy instruction works is no longer in question. Nei- 
ther is there any qu^on about who should be taught thinkii^ strategies. 

Who Should Be Taught 

The fact is indisputable that those who most need instruction in thinking 
tactics receive the least amount of it. Specifically, strategy instruction is 
most important for at-risk students; yet, as a group, they commonly do 
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not receive such instruction- Cionversely, many of the thinking tactics 
that are necessary to process information and deeply understand it are 
already known by middle and high achievers. Th^ commonly learn these 
strat^es in the rich information processing background from which they 
(X)me, 

Students from all ^Kidoeconomic strata engage in &r too many passive 
cx^gnitive activities such as watching television, but students firom middle 
and high-income families: 

■ Are read to more hi their homes 

■ Have more in-depth discussions on substantive topics in their home 

■ Live in a much more complex informational environment 

It is this (implex environment that allows more privileged youngsters 
to spontaneously develop strat^es for learning and thinking. Additional- 
ly, their parents engs^ in more impUdt mediated instruction. Mediated 
instruction means gradually guidicg a learner in the understanding and 
eventual mastery of the steps in a complex strat^. 

At first, the adult c^ers a great deal of guidance to the learner, includ- 
ing an overt model of the strategy. The adxilt gradually decreases the 
amount of guidance (except when needed) to allow the learner to shape 
the strategy and adapt it to his or her own needs and style. 

To understand how mediated instruction is commonly practiced in 
some homes, consider the example of a parent helping a child with a 
homework assignment in mathematics. The parent might first talk the 
child through a few of the problems, suggesting some key steps necessary 
to solving such problems- Next, the parent mi^t ask the child to try solv- 
ing some problems using the steps that were modeled 

As the child tries the steps, the parent offers suggestions, providing 
gentle guidance as ne^ed. Eventually, the parent completely withdraws 
his or her help when it is apparent that the child can perform the home- 
work task independently. 

Even when mediated instruction is not done prof^iy, the parent usu- 
ally provides an explicit model for the strategies needed to complete the 
homework task. This informal, yet powerfiil, instruction allows many stu- 
dents to acquire the thinking tactics necessarj-^ for academic success. 
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Unfortunately, not all children come from home environments where 
such mediated instruction occurs. In fact, the recent national ""report 
cards" on mathematics, reading, and writing from the National Assess- 
ment of Educational Progress indicated that this type of home instruction 
is lacking for at-risk students, most of whom come from minority and low 
socioeconomic status groups. 

This fact alone validates the need for the direct teaching of thinking. 
There is some disagreement, however, about how this should occur. 

How Thinking Should be Tai^t 

There is a continuum of the ways to teach thinking strat^es. At one end 
are approaches that teach thinking explicitly in a content-fr^ environ- 
ment. At the other end are approaches that embed skills within the 
teaching of content. The former is commonly referred to as the explicit 
approadi. The latter is called the implicit approach. 

Barry Beyer is probably the most widely recognized proponent of the 
explicit approach. Beyer asserts that there are five steps to teaching a 
thinking strategy. First, the teacher introduces the strategy. This in- 
cludes describing and demonstrating the steps, explaining when the 
strategy should be used, and naming the strategy. If a teacher were intro- 
ducing a summarizing strategy, he or she would first demonstrate it to 
.<icudents by illustrating each of the steps, then explain that they can xise 
thp strategy whenever they need to capture a large amount of informa- 
tion in an abridged fashion, and finally tell them that the name of the 
technique is ''simimarizing.'* 

During the second step, students would experiment with the strategy 
in a content-neutral manner. The teacher would provide students with 
familiar and interesting contents, allowing them to focus on the summa- 
rizing strategy withoul the interference of new or uninteresting content. 

The third step of Beyer's model has students reflecting on what goes on 
in their minds as they use the summarizing strategy and articulating 
their insights. This might be done in cooperative groups. 

As a result of the discussion, during the fourth step, students would 
make changes in the strategy. Students mig^it determine, for example, that 
they have to add a step or two to those initially modeled by the teacher. 
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Finally, in the fifth step, students would try out the modified strategy 
and again reflect on its use. 

Beyer believes that, in general, students need the eirtensive and direct 
instruction provided by his model before they can use a thinking strategy 
independently. 

Perhaps the most widely used program with an explicit, content-free 
approach is Edward de Bono's CoRT program. The program acquired its 
name from de Bono's organization, the Cognitive Research Trust. CoRT 
contains some 60 thinking strat^es oiganized into six levels. Each strat- 
egy is taught in a rontent-finee environment, and is practiced by students 
imtil they can use it independently. 

At the other end of the continuum are approaches to thinking that 
attempt to teach it implicitly. Steps to thinking strategies are not overtly 
tau^t, but are embedded in content instruction- 
Lauren Resnick is perhaps the most visible proponent of the implicit 
approach. She asserts that thinking does not occur in isolation; we utiUze 
various cognitive strategies only in so far as they help us learn and use 
content. She suggests that the tasks students are asked to perform while 
learning content should model specific typ^ of thinking. 

In a sodal studies class, for example, when asking students to investi- 
gate why President Truman ordered the iise of the atomic bomb during 
World War II, a teacher must also reinforce the thinking strategies 
involved in the mental process of investigation. Similarly, while requir- 
ing students to develop a new way of classifying elements in a science 
class, the teacher should reinforro the mental process of classification. 



Figure 1. Tactics for blinking 

Leaming-ToLeam Strategies 

m Attention Control — Strengthens (X^icentration and lengthens attention span 
m Deep Processing— Raises n^moiy potentiat and depth of infonnation pro- 
cessing 

• Menwry Frameworks — Helps students recall key information 
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■ Power Thinking — Cultivates better student attitudes toward their own 
capabilities 

■ Goal Setting— Helps students create a vision for their own sucM . , I 
m The Responsibiltty Frame— Boosts studente' abHity to l^m Independentiy 

Content Thinking Strategies 

m Concept Attainment — Introduces a method for understanding new con- 
cepts 

■ Concept Development— Provides a way to study new concepts In depth 
m Pattern Recognition — Improves ability to organize and comprehend spo- 
ken or written infomrntion 

• Macro-Pattem Recognition — Expands cx)mprehension of laige bodies of 
information 

■ Synthesizing— Teaches a method for integrating large amounts of new ? 
knowledge \ 



m Proceduralizing — Shows students how to learn new sWlls 
Reasoning Strategies 

m Analogical Reasoning — Prepares students for aptitude tests and helps 

them see relationships 
m Extrapolation — Helps students see relationships between information at 

an abstract level i 

■ Evaluation of Evidence — Develops ability to analyze information for accu-^' 
racy and relevarx^ 

• Examination of Value—Shows how to objectively analyze differing views 

on a controversial topic 
m Non-Linguistic Patterns — Identifies numeric, spatial, and recursive pat* ' 

terns 

■ Elaboration — Demonstrates how to infer from reading 

m Solving Everyday Prdbtems— Provkjes a frBmework for analytical problerti 
solving 

m Solving Academic Problems— Equips students with tactics for solving 
school-related prcAlems 

■ Invention — Stimulates creative thinking and development of unique but 
meaningful products. 
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No program is directly designed to implement the implicit approach, 
but Richard Paul's techniques come very close. Paul's program specifies 
for teachers how to redesign lessons to implicitly reinforce a variety of 
critical thinking strat^es. 

In addition to the programs at the two ends of tht, thinking skills 
instructional continuum, a variety of programs exist at various points 
between the extremes. Administrators and teachers have available a 
variety of options to teach and reinforce thinking. (For a review of the 
various pnyjrams, see the comi^diiuns by Chance and Costa.) 

In the remainder of this chapter, a pn^ram is described that attempts 
to combine elements from the explicit and imphdt ends of the continuum. 

Tactics for Thinking; A Ckimpromi^ Approach 

Tactics for Thinking is a program that includes strategies for increasing 
competency in 22 cognitive skills (see Figure 1). The 22 strategies within 
the program are organized into three broad categories: leaming-to-leam 
strategies, content thinking strategies, and reasoning strategies. 

Learning To Learn 

The tactics within the leaming-to-leam section of the program provide 
student strat^es for regulating their own information processing and 
learning in wf>^ that are personally meaningful and easily accessible. 
For example, the tactic of Attention Control makes students aware of 
their responsibility to pay attention (even in situations in which they do 
not find it easy) and suggests specific techniques for doing so. 

Similarly, the tactic of Power Thinking alerts students to the need to 
monitor and control their attitudes about completing specific classroom 
tasks and provides techniques for doing so. The tactics of Deep Processing 
and Memory Frameworks help students use various aspects of imagery 
(e.g., mental pictiu*es, physical sensations^ and emotions) to integrate 
information into their existing knowledge base in such a way that it is 
easily retrieved and used. 

Content Thinking 

The content thinking tactics are designed to help students comprehend 
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and more deeply pn^s informatdon presented by the teacher or the text- 
book. Tactira in this category deal witfi both declarative and procedural 
information. 

Declarative information (Vhat^) is a knowled^ of incepts, prindples, 
and various types of schema within a given content area* The tactics of 
Concept Attainment and Concept Development help students initially 
acquire and then ultimately make fine distinctions about important ron- 
(^pts. The Pattern Recognition tactic helps students organize and process 
principles and information that conform to such oi^anizational schemata 
as time sequences and causal networks. 

Procedural information is more process oriented (^'how to''). The tactic 
of Proceduralizing is intended to help students identily and articulate 
the important steps in content-related processes. It helps students set up 
a practice schedule to use the process under study until tL?y have mas- 
tered it. 

Reasoning 

The reasoning tactics are designed to help students use information in 
ways that expand and restructure their understanding of content. The 
Extrapolation tactic, for example, helps students understand how the 
abstractions imderlying one piece of information also support another 
piece of information. The Evaluation of Evidence tactic helps students 
analyze information for its validity and relevancy. The Invention tactic 
helps students use information to create unique but meaningful products. 

Implementation 

The tactics program provides students with explicit instruction in think- 
ing strategies, but it is not meant to be used as a "pull-out'' program. The 
strategies are not designed to be taught in a separate course, isolated 
from content. Rather, they chould be used in a regular classroom situa- 
tion to enhance students' learning of important content. 

At first, the strategies must be cued by the teacher. For example, a 
teacher might begin a class by reminding students of the Attention Con- 
trol tactic and guiding them through its use to increase their instruction- 
al focus. Then the teacher might present a new concept using the Concept 
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Attainment or Concept Development tactics. Finally, he or she mig^t help 
students see how the new concept relates to other a>ncepts through the 
Extrapolation tactic 

When students have internalized the tactics, they then can use them 
without aid or cuing frcjin the teacher. A student might notice that she is 
not focused on the lesson and use the Attention Control tactic to enhance 
her readiness for learning. As the teacher presents tiie le»3<m, the student 
mig^t decide to use aspects of the Concept Development tactic to help her 
tmderstand an important concept that has been presented* Finally^ she 
might decide to use aspects of the Exteapolation tactic to make connec- 
tions, not explicit in the lesson, with other informaticn she has learned. 

Ultimately, the Tactics program is a way for teachers, schools, or dis- 
tricts to begin exploring the teaching of thinking. It is not meant to be 
implemented as a complete program, but teachers, schools, or districts 
can select those tactics that they find most useful for particular content 
areas or classrooms. 

Teachers are also encotiraged to adapt the strategies to meet their 
specific needs. Many of those who use the pn^pram, for example, collapse 
aspects of the Concept Attainment tactic and the Concept Development 
tactic into a single strategy that guides students through the initial 
introduction of a concept to its mature development. At a more formal 
level, some schools '^nd districts embed selected tactics into their cur- 
riculum objectives, rhey select specific tactics fix)m the list of 22 to be 
taught at specific grade levels or in specific content areas. Figure 2 
shows eight tactics selected by a given school: Attention Control, Deep 
Processing, Power Thinking, Concept Attainment, Pattern Recognition, 
Extrapolation, Evaluation of Evidence, and Everyday Problem Solving. 

The school has determined that Attention Control will be taught at the 
second grade level as an aspect of classroom rules and pnnredures. Deep 
Processing will be taught at the third grade level as part of language arts, 
and so on. In this way, various tactics are systematically introduced into 
the curriculum without burdening teachers or students- 
Individual tactics can also be taught prior to their designated introduc- 
tion. A third grade teacher, for example, might decide to introduce Pat- 
tern Recognition as part of her reading class, even though that tactic was 



22 - 



A Rationale and Fr am ework 



not slated to be generally mtroduced until the fourth grade. Specifying 
where selected tactics should be tatight in the oirriculiun simply ensures 
that students will be introduce to them sometime in their school experi- 
ence. 



Rgure 2. Sample Placement of Selected Tactics in Curriculum 



Tactic introduced 



Grade Levet/Cont&nt Area 



Attention Control 



Second grade: classroom rules and 
procedures 



Deep Processing 



Third grade: language arts 



Power Thinking 
Concept Attainment 



Third grade: classroom rules and 

procedures 

Third grade: science 



Pat;am Recognition 
Extr^olation 



Fourth grade; reading 
Fifth grade: social studies 



Evaluation of Evidence 



Sixth grade: social studies 



Everyday Problem Solving 



Seventh grade: heatth 



Thus, teachers can know which tactics students have been exposed to 
and not waste valuable class time introducing those tactics- Knowing that 
Extrapolation has been taught at the fifth grade level as part of social 
studies instruction allows the sixth grade science teacher to use it with- 
out having to teach it. Of course, some review and reteaching may nee- 
essary. 
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Since its inception, the Tactics program has been ^rtensively test^ and 
has been shown to enhance students' performance in the strategies that 
are taught as well as improve their performance on standardized tests. 
(For a summary of the evaluations of the program, see Marzano, 1989.) 
Tactics for Thinking (Marzano and Arredondo, 1986) is a good place to 
start It is simply a set of cognitive strat^ies to be tai^t fay teachers and 
used by students to enhance control over and facility with the learning 
process. Once a few selected tactics have been intnxhiced by the teacher 
and internalized by students, both can move on to more complex, and 
more self-initiated, learning strat^es. 

In the final analysis, the teaching of thinking will not be accomplished 
by adopting a program or a set of practices. Rather, it requires a commit- 
ment on the part of administrator, teachers, and parents to rethink their 
educational goals in curriculimi, instruction, and assessment and to plan 
school improvement initiatives that incorporate thinking strategies. 
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Francis Schrag 

Teaching students how to think rather than wfuU to think is not a new 
idea, but it is one that has caught fire among educators and education- 
al writers during the past decade. Unfortunately, there has not been 
enou^ thinking about what it means to teach people how to think. 

How lb Think About TfainMng 

To many educators, teaching students how to think is like teaching any 
set of skills, such as driving a car, adding fractions, or writing a business 
letter. The teacher's job is to break down a copies activity into its compo- 
nent parts, to demonstrate and explain how to perform each component, to 
provide plenty of opportunity for practice, and then to supply feedback. I 
don't think this is a fruitful way to think about teaching thinking. 

As I see it, teaching students to be better thinkers is more like teach- 
ing them to be coiuageous than like teaching them to drive a car. Let me 
explain this perhaps puzzling statement. 

My favorite analogy for thinking about thinking is territorial explo- 
ration: Thinking is the mental coimterpart of exploration. Just as explor- 
ers need different skills and different information depending on the ter- 
rain, so thinkers need different skills and different information depending 
on the domain they are working in. One cannot be an effective thinker 
without the relevant skills and information. Yet, the possession of skills 
and information does not by itself guarantee success in solving problems 
any more than in exploration* The explorer needs courage, determination, 
and sound judgment regardless of terrain. I call these character traits or, 
to use an apt if old-fashioned term, virtues. likewise, the effective thinker, 
r^ardl^ of domain, needs to be thoui^t-ftiU.^ 

Just as courage does not lie so much in mastering a difficult skill as 
in resisting temptation to flee from or concede to powerful forces, so 
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thoughtfulness involves being able to resist the temptation to act impixl- 
sively or in a stereotyped manner. The good thinker avoids precipitous 
action and avoids getting stuck in a rigid response. He or she is deliber- 
ate as well as flexible. 

What are the advantages of my way of thinking about thinking? There 
are several: Firet, it makes it less likely that we will f(K)l ouraelves into 
believing that equipping students with any set of skills, procedures, 
recipes, or formulas is teaching them to he better thinkers. Second, my 
formulation prevents us from supposing that we can set aside one part of 
the day or the week to teach thinking as an additional subject on a par 
with arithmetic, driver's education, and the like. Third, my formulation 
prohibits our focusing our efforts on just one part of the school population 
or one curriculum area. Finally, it forces us to focus our attention on some 
of the conditions in and out of the school that weaken our efforts to pro- 
mote bettor thinking. This last point requires elalK)ration. 

Suppose we wanted to teach young people to be courageous. We would 
need to exhibit courage ourselves; and we would need to immerse stu- 
dents in environments in which courage was both needed and held in 
high esteem. The same goes for thoughtfulness. If we wish to cultivate 
thoughtfulness in the young, we must model it ourselves, and we must 
design environments that both elicit and reward it. 

Are Schools Places for Thinking? 

Is the conventional classroom well-designed to eUcit and reward thought- 
fulness? To answer this, consider a spectrum of settings that support 
thoughtfulness to different degr^s. On one end of the spectrum are those 
settings that are least supportive of thoughtfulness. The factory assembly 
line, where each worker is expected to perform a single task every so 
many seconds or minutes, is the best example. 

Now consider an environment at the other end of the spectrum— the 
scientific laboratory. The structure of the laboratory includes a number of 
feattnres that reinforce thoughtfulness: 



1- I am not using 'thoughtful'' here to mean '^showing r^ard for others,'' although 
I believe there is a connection between the two meanings. 
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■ A high degree of autonomy accorded the problem solver, especially 
so fietr as the allocation of time is concerned. 

■ Extensive collaboration among members of the laboratory requires 
them to move alK)ut freely. (This collaboration within the group is 
complemented, of a)urse, by fierce comi^tion l^tween groups.) 

■ Norms and procedures exist which ensure that the results and those 
responsible for them are publicized beyond the laboratory. 

■ Norms and prccedures are in place that reward both the originality of 
a contribution and its defensibihty. 

Note that these features of laboratory sdent^ are not present primarily 
to make scientists feel good about their work, but rather to facilitate the 
scientific work itself. These characteristics are present to some degree in 
all environments that require thoughtfulness, from medical clinics to 
automobile service stations. 

Schools are not assembly lines, but the similarity between factories and 
schools has been noted, not just by wild-eyed opponents of traditional edu- 
cation but by responsible critics and observers such as Albert Shanker, 
president of the American Federation of Teachers. The fact is that schools 
rarely provide students with the kinds of tasks that require thoughtful- 
ness; i.e., tasks that are challenging, long term, open ended, difficult to 
assess in a mechani<^ way, and that invite collaboration among students. 
The absence of such tasks and the conventional classroom setting make it 
possible for schools to divide the day into 45-minute periods, to provide 
uniform, frequent, and easily assessed examinations, and to discourage 
collaboration. 

I do not believe that the typical classroom in the typical school is this 
way because of either ignorance or ill-will on the part of teachers and 
principals. Indeed, I argued in Thinking in School and Society (1988, p. 
101) that the factory-like environment of most schools is an ''inteUigent 
adaptation of rational actors to perceived imperatives,'* What leads to the 
factory model, on my analysis, is two "^givens" of schooling: the compul- 
soriness of schooling together with a grading system in which some can 
"win'' only if others ^lose."* 

These givens create a continual threat of disorder on the part of those 
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who must continue to attend school, even if they do not perceive their 
chances of winning to be very high. It is teachers' perceptions of this 
threat that makes it rational for th^ to assign tasks that rei^mble those 
of the assembly line more than ^ose of ^e laboratox?- 

Must we accept these givens? Our commitment to universal high 
school completion is not likely to waver, even though it is still far from a 
reality. Although experiments with alternative grading systems have 
been tried over the years, conventional j^tems will remain dominant so 
long as school grades are used as criteria for entrance to selective col- 
leges. 

There are exceptions to this factory pattern, to be sure, but careful 
study of such examples reveals that they are likely to be found either in 
classes where students are unusually motivated (or few in number), or 
where teachers exhibit unusual talent. We cannot expect to make these 
exceptional classrooms the general rule. 

This does not mean that we must throw up our hands in despair, but 
neither should we de^^ive ourselves about the dimensions of the chal- 
lenge. There are, I believe, two directions we can explore: 

■ We can create more "thoughtfur settings that supplement the con- 
ventional classroom, 

■ We can raise the level of thoughtfulness in the conventional classroom 
incrementally. 

Creating New Settings for Thinking 

The challenge of creating new settings that reward thoughtfulness 
requires imagination, experimentation, and a willingness to take risks. 
Fortunately, we are not without models both within and outside the 
school If we look within a high school, the school newspaper provides us 
with a setting that demands thoughtfulness; indeed, here is a setting 
that embodies many of the features of its real- world counterpart. The 
editors and reporters collaborate; the authors are publicly identified and 
accotmtable for their stories; the work cannot be confined to a particular 
place or time, and so on. 

I believe that we must invent new settings which, like the school news- 
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paper, demand and reward thoughtftilness. One idea I have projK^ed is 
the social policy research institute, or *^unior Uiink tank** as I like to call 
it. A group of interested students under adult guidance from either a 
teacher or a professional policy analyst, would focus on a problem of con- 
cern to the adolescent and adult community: teenage pregnancy, drugs, 
racial hostility, or the droiwnit problem, to name a few possibiUties. The 
group would meet once or twic^ a week, either in or out of school, and for 
several hours at a time. As in adult policy centers, the goal would be to 
learn as much about the problem as possible and to make recommenda- 
tions to the school and community administrations. 

The group would develop its own agenda as it went along, with only 
the general mission agreed upon at the outset Students would encounter 
and need to resolve questions dealing with a range of issues from the eth- 
ic of confidentiality, to problems of research design, to the most effective 
way to present their results. Pilot pngects might try out different ways of 
dealing with some of these problems. Consultants could be called on as 
the need arose. 

Although the adult leader would supervise the effort, the adolescents 
wouJd be allowed to make their own mistakes. Students would be intro- 
duced to some techniques and concepts needed to <»rry out the work, and 
would look at examples produced by adult centers, but there would be no 
expectation that the group would employ the sophisticated techniques 
available to adult policy researchers. Whatever skills or ideas had to be 
mastered would be learned only because of the actual requirements of the 
proje<!t. The project would be expected to issue a report to the entire com- 
munity. 

If school leaders are serious about teaching thinking, they must not 
only experiment with new ideas like the junior think tank, but also 
change their thinking about some of the activities that, like the newspa- 
per, already exist but are considered peripheral to the educational pro- 
gram. 

Many high schools host a wide range of activities such as science fairs, 
peer courts and counseling programs, filmmaking, and debating clubs, 
which demand thinking of the highest order. These programs often elicit 
a level of student and faculty commitment that is not found in the class- 
room. I daresay that many of these activities have more educational mer- 
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it than those that take place within the curriculiun. 

I favor importiBg them into the regular school week and making them 
part of the curriculvim. If a wide range of such activities were available, 
every student could be a participant in an activity of his or her choice. If 
more students want to write for a newspaper than the editore and facul- 
ty adviser can find room for, the prindpal should find an additicmal fac- 
ulty member interested in guiding the pul^cation of a rival newspaper. 

All this is easier to propose than to carry out, and I must admit that 
the suggestions made so far require a degree of restructuring that may be 
unrealistic for many schools, but the perspective argued for in this chap- 
ter applies to the a)nventional dassroom setting as well. 

Promoting Thou^tfdlness in the Classroom 

Can we identify the characteristii^ of classrooms that foster thoughtfil- 
ness? Building upon my conception of good thinking, a group of researchers 
at the National Center on Effective Seamdaiy Schools (NCESS), under the 
leadership of Fred Newmann, has be^ occupi«i with this question fen- sev- 
eral years.^ The research has so far focus^ exclusively on social studies, 
but the criteria for ^thoughtful lessons'* we have evolved would appear to 
apply to a wide range erf subject matters. 

Our team developed a set of rating scales for **thoughtful lessons" 
which v/as ultimately reduced to six main dimensions. Teachers and 
administrators roncemed about improving the quality of thinking in their 
schools might adopt or adapt these scales to assess thoughtfulness in 
their classrooms. 

Dimension I. There was sustained examination of a few topics 
rather than superficial coverage of many. 

Thoughtfiilness is supported by in-depth study and sustained concentra- 
tion on a limited number of topics or questions. Lessons that cover a large 
XiUmber of topics give students only a vague familiarity or awareness and, 
thereby, reduce the possibilities for biulding the complex knowledge and 



2. A comprehensive summary of the methods and results of this research project 
may be found in Newmann*s chapter, listed at the end of this chapter. 
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skills required to understand a topic 

Dimension 2. The lesson displayed substantive coherence and 
continuity. 

Progress toward understanding complex topics demands systematic 
inquiry that builds on relevant, acciurata, and substantive knowledge in 
the field, and that works toward the logical development and integration 
of ideas. In a>ntrast, l^^sons that teadh material as unrelated firagments 
of knowledge, without pullii^ them t<^ether, imdermine such inquiry. 

Dimension 3. Students were given an appropriate amount of time 
to think; that is, to prepare responses to questions. 

Thinking takes time, but often recitation, discussion, and written assign- 
ments pressure students to make responses before ^hey hsve had enough 
time to reflect. Promoting thoughtfuiness, therefore, requires periods of 
silence where students can ponder the validity of alternative responses, 
develop more elaborate reasoning, and experience patient reflection. 

Dimension 4. The teacher asked challenging questions and/or 
structured challenging tasks suitable for the ability level and 
preparation of the students. 

Thinking occurs only when students are faced with tasks that demand 
non-routine mental work. Students must be faced with the challenge of 
using prior knowledge to gain new knowledge, rather than the task of 
merely retrieving prior knowledge. 

Dimension 5. The teacher was a model of thoughtfuiness. 

To help students become more thoughtful, teachers themselves must 
model thoughtfuiness. Key mdicators include showing interest in a stu- 
dent*8 ideas and in alternative approaches to problems; showing how he 
or she thought through a problem (rather than only the final answer); 
and acknowledging the diflSculty of gaining a definitive xmderstanding of 
problematic topics. 

Dimension 6. The teacher was a modeVof thoughtfuiness. 

The answers to difficult questions are rarely self-evident. Their validity 
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often rests on the quality of explanatian or reasons given to support them. 
Therefore, beyond offering answers, students must also be able to produce 
explanations and reasons to support iheix mndusions. 

The NCESS research team used the indicatox^ to study several hun- 
dred hi^ school »)cial studies dass^ in 16 schools. AlHioi^^ the level of 
thoughtfulness in the average social studies classroom left much to be 
desired, we found that some teachers and some smal studies depart- 
ments were able to adiieve consistently hi^ scores on our indicators. 

Departments that scox^ highest distinguished themselves from the 
lowest scorers by the kind of instructional leadership offered by the 
department chair and the principal. Although each of the top scoring 
departments t(K>k a different approach to the promotion of thinking, all 
the department chairs provided programmatic leadership in three ways. 

They helped to generate a departmentwide commitment to the promo- 
tion of thinking as a central goal. They stimulated and participated in 
curriculimi development aimed at the goal. And, they encouraged a colle- 
gia! climate for teachers to examine their own teaching practices. 

Furthermore, prindpals in the successful schools supported the work 
of the department chairs by showing their personal comraitment to the 
instructional goal, by providing resources for staff development^ and, in 
one rase, by observing teachers and giving constructive feedback on their 
efforts to promote thinkii g. 

Barriers do exist to nusing the quality of thinking in school class- 
rooms, but oixr research shows that these barriers are not insurmoimt- 
able. The task of des^ning and instituting thoughtiul settings beyond the 
conventional classroom has not yet begim. My personal view is that the 
best chance for fostering the virtue of thoughtfulness lies in the creation 
of such new settings. 
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Using Scaffolds for Teaching Hi^er 
Level Cognitive Strategies 

Bamk Ro^nshine and Jo^pk Ouenther 

Ciirrently, there is a starong interest in teadiing students higher level 
cognitive s^tegies. A great deal has bron written about the ne^ to 
teach students to use ct^nitive stra^^es in all areas of the curriculum. 
However, little reliable information is available on how to teach these 
higher level strategies. Instruction often fails, not because the idea is 
poor, but because the instruction is inadequate. 

There is a wealth of material— as yet imtapped—that can provide infor- 
mation on how to teach a^nitive strat^es. This information can be foxmd 
in successful experimental studies that have attempted to teach students 
specific cognitive strategies such as summarizing a passage, generating 
questions about the material they read, and writing descriptive and argu- 
mentative essays. A good number of these studies have appeared since 
1984, and there are now a sufficient number to merit using them as a 
resource. This resource should enable us to develop a richer, more elabo- 
rate set of instructional ideas on how to teach cognitive strategic. 

The Importance of Scaffolds 

A major organizing concept for the teachingAeaming of higher order cog- 
nitive strategies is the scaffold (Palincsar and Brown, 1984; Paris, Wix- 
son, and Palincsar, 1986; Wood, Bruner, and Ross, 1976) or instructional 
support (Tobias, 1982). A scaffold is a temporary support provided by the 
teacher (or another student) to heln students bridge the gap between 
their current abilities and the goal. 

A scaffold is temporary and adjustable. It is used to help learners **par- 
tidpate at an ever-increasing level of competence** (Palincsar and Brown, 
1984, p. 122), and it is gradually withdrawn as the learners become more 
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independent. This use of scaffolds appears to characterize successful 
instruction in cognitive strat^es. Altbov^ i^^ffolds are useful for teach- 
ing all skills, they are particularly useful, and often indispensable, for the 
teaching of less structured or higher order skills. 

In the studies we read, various typ^ of i^^affolds were to assist the 
learner at each stage of learning. During the initial stage, the scaffolds 



Table 1 . Elements for Teaching Skill - Specific Higher Order Skills 

1- Preinstructlonal activities. 

a. Begin instruction within the area where the student will benefit from 
instn^on, 

b. Develop specific scaffolds that help students leam the skilL 

c. Regulate the difficulty by starting with simplified material and gradu- 
ally increasing the complexity of the task, 

2. Present ttre new skills using: 

a. Modeling of the skill by the teacher 

b. Thinking aloud as choices are made 

c. Anticipating and precorrecting student difficulties, 

3. Guide student practice with: 

8- Teacher-led practice 

b. Reciprocal teaching 

c Provision of cue cards 

d. Use of hatf-finirhed examples. 

4. Provide for feedback and self-choking. 

5. Provide independent practice with new examples, 

6. Facilitate application to new examples. 
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included o^nitive fadlitators, modeling of the process by the teacher, and 
thinking aloud As the students b^an to practice, the support ronasted of 
prompts, aids, suggestions, guidazu^ from the teadi^, and teacher model- 
ing of the task when necessary. As instruction proceeded, other students 
provided the support 

After sUiden^ had completed some tasks on their own, the scaffolding 
provided them with models to which they compared their work (Collins, 
Brown, and Newman, 1^)). In addition, checklists assisted students in 
developing a critical eye toward their work. Throughout this process, 
there was a gradual decrease in scaffolding as the students became more 
proficient. 

This chapter will expand upon the initial conception of scaffolded 
instruction by providing specific examples at each stag^ of the learning 
process. Examples are drawn from successful studies that have taught 
the implicit skills of question generation, simunarizing, and test taking. 
As the reader will see, the con<^pt of instructional support and scaffold- 
ing can also apply to the teaching of explicit skills and serve to enhance 
the teaching of these skills. 

Research Basis 

Six m^jor instructional elements appear in succe^fiil studies (see Table 
1) that may provide a tentative model for teachii^ higher level cognitive 
strategies. Each of these elements is described below. 

1. Preinstructional activities. 

Three activities need to take place before instruction: determining 
whether the material is within the learners' abilities, developing cc^nitive 
facilitators, and selecting appropriate materials. Each of these is explainai 
below. 

■ Determining whether the skill lies within the learners' zone of proxi- 
mal development. 

A major limitation that must be kept in mind is that scaffolds only 
apply within the student's ''zone of proximal development'' (Vygotsky, 
1978; Palincsar and Brown, 1984), the area in which the student cannot 
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proceed by herself, but can do so when guided by a teacher using these 
supports. The zone of proximal development means that a teacher will 
not be successful if he or she tries to teach material for which students 
do not have the necessary background knowledge. Thus, a teacher must 
first assess whether the student has the background knowledge to prof- 
it from the instruction. 

■ Developing specific scafiblds (cc^nitive facihtatons) that students use 
to help learn the skilL 

Cognitive strategies caimot provide students with all the steps the/ 
must master with such explicit skills as long division or writing biblio- 
graphic cards. Instead, when teaching cognitive strategies, the investiga- 
tors (Scardamalia and Bereiter, 1985) developed and taught cognitive 
facilitators — ^heuristics or dues that support the learner during the early 
stages of learning the strategies. Cognitive facilitators are suggestions 
specific to a skill that help students bridge or scaffold the gap between 
their abiUties and tiie task. Different cognitive facilitators were used with 
different skills. 

In some of the studio, students were taught the comprehension-foster- 
ing skill of generating questions after they had read a paragraph or a pas- 
sage. (This skill provided students with ^'question words" — who, what, 
where, why, how — that they used as prompts to help them generate ques- 
tions. 

For another cognitive strategy, the ability to sxxmmarize a paragraph, 
students were taught to use the following procedures: 

■ Identify the topic 

■ Write two or three words that reflect the topic 

■ Use these words as a prompt to figure out the main idea of the para- 
graph {Baimiann, 1984) 

■ Select two details that elaborate on the main idea and are important to 
remember 

■ Write two or three sentences that best incorporate these important 
ideas (Taylor and Frye, x988X 
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In the area of writing, Englert and Raphael (1989) provided Plan 
Sheets that cued students to consider their audience ("Who am I writing 
for?'' ^'Why am I writing thisD, and Organize Sheets to help them orga- 
nize then- ideas mU categories (How can I group these ideas?" **What is 
being e3q>lainedr' *TVhat are the stepsr 

For the content area of physics (I/arkin and Reif, 1976) helped college 
physics students solve problems in mechanics by providing facilitators to 
help them generate theoretical descriptions of problems in mechanics. 

A variety of cognitive facilitators or specific scaffolds have been devel- 
oped and used successfully for teaching cognitive strategies. No rules 
exist, as yet, for developing cognitive facilitators, but the reader is encour- 
aged to use these examples to develop his or her own fadlitatora. 

■ Regulating the difficulty by starting with simplified materials and 
gradually increasing the complexity of the task, and/or teaching each 
step separately. 

Many investigators regulated the difficulty of the tasks by beginning 
with simpler problems and then gradually increasing the diflSculty. The 
purpose was to enable the learner to begin at an appropriate level. 

For example, in a study by Palincsar (1987) where students were 
taught to generate questions, the class began with questions about a sin- 
gle sentence. The teacher first modeled how to generate questions and fol- 
lowed this with student practice. After this initial practice, the complexity 
was increased to generating questions about a paragraph. Finally, the 
teacher modeled and the class practiced generating questions after read- 
ing an entire passage. 

Another way of regulating the level of difficulty is to teach only one 
part of a cognitive facilitator and provide for student practice on that 
part. In a study by Blaha (1979), for example, only one part of the strate- 
gy for summarizing was taught at a time. The teacher first explained and 
modeled identifying the topic of a paragraph and provided for student 
practice on new paragraphs. Then she taught the concept of the main 
idea and students practiced finding both the topic and the main idea. 
Next, she taught students to identify the supporting details, and students 
practiced all three steps of the strategy. 
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2. Teacher activities for pre^ting the cognitive strategies included model- 
ing the process, thinking aloud as choices were made, and anticipating and 
precorrecting student difficulties. 

ModeUng of the steps and the thought process is important for all in* 
struction, but modeling is particularly important for teaching strategies 
when many of the steps are hidd^ from the learner. This modeling of 
cognitive facilitators takes place as the teacher provides examples. In 
these studies, many teachers modeled the use of the specific scaffolds by 
working examples. 

For example, when teaching students to generate nuestions, the 
teacher modeled the use of the specific scafiblds for generating questions. 
When teaching students to write a simimary, the teacher modeled each 
step: identifying the details, using the details to form a main idea, and 
stating the details in the summary. This modeling was usually done in 
small steps, with each step followed by student practice. 

Another form of modeling, thinking aloud, al^ appeared in some stud- 
ies. Thinking aloud is modeling the thought processes as one applies the 
strategy. When teaching students to generate questions, for example, the 
teacher mi^t model the thou^t process of starting with a question word 
such as "Tlow^ or '^Why.*' Or, when teaching the strategy of simimariza- 
tion, the teacher might think aloud as the topics are selected and then 
use the topics to generate a summary sentence. 

Modeling and thinking aloud were also used for a mathematics study 
in which the teacher went through the steps in solving mathematical 
problems (Schoenfeld, 1985). Thinking aloud by the teacher is particular- 
ly useful for novice learners because such expert thinking is usually hid- 
den firom the student. Indeed, identifying the hidden strategic of experts 
to make them available to learners has become a focus of research 
(Collins, Brown, and Newman, 1990), 

In many of these studies, the teacher also anticipated and discussed 
potential student errors. For example, errors in smnmarizing were antici- 
pated by presenting a summary with a poorly written topic sentence and 
asking students to identify the problem. In another study, the teacher 
showed questions that were inappropriate because they focused on a 
minor detail, and asked students to state why they were inappropriate. 
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Or, the teacher showed questions that wei^ too broad to axiswered 
from the text and asked students to decide why these questions were 
inappropriate. In another example, the teacher show^ a)rrect and incor- 
rect summaries and discussed the problem in the incorrect summary. 
Developing the^ kinds of example require considerable teacher experi- 
ence and experti^. 

The technique of anticipating student errors was also a hallmark of 
expert teaching in mathematics (Leinhardt, 1986; Borko and Livingston, 
1989). These teachers observed that, *With experience, you can pinpoint 
mistakes studc uts make ahead of time. The more you teach, the more you 
realize where the pitfalls ai^."* (Borko and Livingston, 1^0, p. 490.) 

3, Teachers guided student practice a$ they attemp ted new examples and 
problems. 

Guided practice, a term that originated in the teaching of well-struc- 
tured skills, also applies to the teaching of cognitive strategies. For cc^ni- 
tive strategies, this guidance consists of giving hints, giving reminders of 
the facilitators, giving reminders of what was overlooked, and giving 
suggestions about how something could be improveA 

During guided practice, the students participated by giving answers 
and deciding on the correctness of other students* answers. For the strat- 
egy of summarizing, for example, the teacher m(Kieled the steps of delet- 
ing redxmdant sentences, pr^ented another paragraph, and had students 
signal when they heard a redundant sentence. When learning to summa- 
rize, students wouJd list details that supported a topic and decide which 
were the most important details. 

Students were called upon to justify their procedures, when appropri- 
ate, by explaining their thinking. By this process, students^ oversimpli- 
fied and naive conceptions are revealed,** (Brown and Campione, 1986). 
This dialog may also aid undei^tanding. 

As Brown and Campione (1986) write, "TJnderstanding is more likely 
to occiir when a student is required to explain, elaborate, or defend his or 
her position to others; the burden of explanation is often the push needed 
to make him or her evaluate, integrate, and elaborate knowledge in new 
ways.** 
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■ Reciprocal tmcking. In some stixdies, guided practice took place in the 
context of a dialog betwwn teacher and staidents known as reciprocal 
teaching (Palinraar and Brown, 1984). Students and teacher rotated 
in the role of teacher. This practice shifted responsibility to students 
and gradiially internalized the skills. 

■ Work in smcdl groups. In some studio, notably those conducted with 
high school and college students, the students practiced the task in 
small groups without the teacher. King (1989, 1990) reported that 
after hearing a lecture, students met in small groups and practiced 
generating questions about the lecture. 

This small-group practice also occurred in reciprocal teaching; stu- 
dents first worked with the teacher, and then practiced in small 
groups without the teadier, A study by Nolte and Singer (1986) found 
movement toward independence in these groups. In this study, stu- 
dents fu'st spent three days in groups of five to six, three days in 
pairs, and then alone. 

■ Cue cards. During guided practice in some of these studies, students 
were provided with cards containing the facilitators they had been 
taught. An example of this scaffold appears in the study by Billings- 
ley and Wildman (1988), who gave students a list of question words 
to use during their practice sessions. Singer and Donlon (1982) used 
a list of the five-story grammar elements (i.e., leading character, 
goal, obstacles, outcomes, theme) for the story they were teaching. 
Wong and Jones (1982) gave each student a cue card which listed the 
steps to consider in writing a sinnmary of a paragraph. After the stu- 
dents used the prompts to develop fluency, the cues were removed 
and they were asked to formulate questions or write summaries 
without prompts. Cue cards were used in studies at all levels, from 
third grade through college. 

■ Half -finished examples. Another way of reducing initial complexity 
and providing guidance for students was to furnish half-finished 
examples. In the successful studies by King (1990), students were 
taught to generate questions about the material they read. King pro- 
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vided the students with **question starters" or half-written questions 
like the following: 

How are and alike? 

What is the main idea of 

What is a new example of ? 

Later, of course, these supiH>rts were withdrawn. These half-finished 
examples served the same function as scaffolds; that is, they supported 
the student and reduced the romplexity in the early stages of learning. 

4. Students were given checklists to use in evaluating their work and 
guided practice in use of the checklists. 

Teachers in a number of studies provided self'<:hecking pnx^ixres to 
aid students in becoming more Independent. In teaching students to sum- 
marize a passage, for example, Rinehart, Stahl, and Erickson (1986) had 
them use the following checklist to check their simunaries: 

■ Have I found the overall idea that the passage is about? 

■ Have I found the most important information that teli^ me more 
about the overall idea? 

■ Have I used any information that is not directly about the main idea? 

■ Have I used any information more than once? 

In some studies, the teacher also mcKieled the use of the checklist and 
offered guidance in its use. 

Checklists have also been employed in writing programs. They range 
from ones on punctuation (e.g., **Does every sentence start with a capi- 
tal?) to those that focus on style elements. For example, students being 
taught to write explanatory material were also taught to ask, ""Did I tell 
what materials are needed?'' "Did I make the steps clear?" (Englert and 
Raphael, 1989). 

Even though checklists were part of these studies, we do not know how 
useful they were. One might argue that students need a good deal of 
knowledge and skill in order to know what they don't know. A question 
such as, "How well did my question link the information together?" will 
not be much help to students who answer "Poorly.'' More research is 
needed on the development and usefulness of checklists. 
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5. Independent practice with new examples was provided. 

All studies provided for extensive and varied independent practice, 
including <x)nsoIidation activiti^ for putting all the procedures togeth^. 
A gradual transfer of rasponability took place. The prompts and sup{K)rts 
were diminished, and the teacher's role shifted firom Mach to that of 
supportive and sympathetic listener (Palincsar and Brown, 1984). In 
some studies, the independent practice was follow^ by discussion of the 
papers or by having students compare their work with a model developed 
by the teacher. 

6. Students applied the learning to new examples. 

The extensive practice with a variety of materials — alone, in groups, or 
in pairs — had another function, that of decontextualizing the learning. 
The strategies were freed from their original "bindings'* and applied, easily 
and unconsciously, to different types of reading. More accurately, the 
readings served to link the strategy to a richer set of contexts, and these 
contexts then suggested the strategy. 

Summary of Findings 

This review of the methods used in studies of cognitive strategies in lan- 
guage arts has yielded a number of new instructional procedures that can 
b- added to a teacher's repertoire. These elements enlarge our technical 
vocabulary and may be useful for improving the teaching of both well- 
structured skills and a)gnitive strategies. A general term that might be 
used for these elements is scwtolds (Palincsar and Brown, 1984; Wood, 
Bruner, and Ross, 1976) in that these variables support student learning. 
This research suggests nine instructional support strategies. They are: 

■ Presentational Variables 

1. Provide specific scaffolds 

2. Regulate the diflBculty 

3. Model use of the facilitator 

4. Think out loud 

5. Anticipate diflScult areas 
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■ Giiided Practice Variables 

6. Use reciprocal teaching 

7. Provide cue cards 

8. Provide half-fimshed examples 

■ Feedback Variable 

9. Provide checklists 

Comparison with Direct Instroction/EIxplicit Teacbing 

How does the present work compare with the direct instruction or explicit 
teaching model that was presented some years ago (Rosenshine and 
Stevens, 1986; Rosenshine aini Berliner, 1987)? Some m^or oate^ries of 
behaviors such as presentation, guided practice, and independent practice 
appear in both models. It is also interesting to note that all the scaffold 
variables di^russed here can be used to enhan<^ the teaching of explicit or 
well-structured skills. No conflicts exist. This new research provides help 
for the teaching of both well-structured and cognitive strategies. 

One clear advance in this research is the intnxiuction of a new instruct 
tional concept, scaffolding. Scaffolds, and the procedures for instruction in 
their uuse, provide suggestions for thinking about how to teach and to help 
students learn other less-structm^, implicit skills. Scaffolds may be use- 
ful for teaching self-enhancing skills such as autonomy, independence, 
and problem solving in specific content areas. Perhaps the strategies in 
these studio can be applied to the development of many desired but less- 
structured goals. 

This research suggests that there is a continuum from well-structured 
to cognitive strategies Some of the elements, such as presenting informa- 
tion in small steps and providing guided practice, are important at all 
points in the continuum. As one moves from well-structured to cognitive 
strategies, however, the instructional value increases for providing stu- 
dents with supports and scaffolds — models, facilitators, think-alouds, 
simplified problems, prompts, and hints — during the presentation and 
gtuded practice phases. 

The variables in this review are at a middle level of specificity. They 
support the student but do not specify each step to be taken. There is 
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something appealing about this middle level. It does not have the sped- 
ficity of behavioral objectives that seem overly demanding to some, nor 
the lack of instruction that many criticdzed in discovery leamii^. Perhaps 
it is the beginning of a new synthesis. 

Raferences 

Baumann, J. F. *Th€ Effectiven^s of a Direct Insl^ction Paradigm for Teaching 
Main Idea Comprehension.'' Reading Research Quarterly 20 (1984): 93-116. 

BilUagsley, B, S., and Wildman, T. M. **Qu^tion Generation and Reading Com- 
prehension.* Learning Disability Research 4 (11^58): 36-44, 

Blaha, A. The Effects of Answering Self-Generated Questions on Reading/" 
Doctoral dissertationt Boston University School of Edixcatdon, 1979. 

Borko, H,, and Livingston, C. "Cognitions and Improvisation: Developing in Math 
Instruction by Expert and Novice Teachers.* American Education Research 
Jourmil 26(1989): 473-99. 

Brophy, J. E., and Good, T. L. "Teacher Behavior and Student Achievement.'' la 
Handbook of Research on Teaching, 3d ed., edited by Wittrock. New 
York: MacmiUan, 1986. 

Brown, A. and Campione, J. C. "I^ychological Theory and ^e Study of Learn- 
ing Disabilities,'' American Psychoh^t 4ia986): 1059-1'^^. 

Collins, A-; Brown, J. S.; and Newman, S. E. "Ck^n^tive Apprenticeship: Teaching 
the CraiEls of Reading, Writing, and MatJiematics."' In Knowing, Learning and 
Instruction: Essays in Honor of Robert Giaser, edited by L, Resnick, HillsdaJe, 
N.J.: Erlbaum Associates, 1990. 

Englert, C- S., and Raphael, T. E. **Developing Successfully Through Cognitive 
Strategy Instruction,' edited by J. J. Brophy. In Advances in Research in 
Teaching, Vol. 1, Newark, N. J.: JAI Press, 1989. 

King, A. **Effects of Self-Questioning Training on College Students' Comprehen- 
sion of Lectures." Contemporary Educational Psychology 14(1^9): 366-Sl. 

. Improving Lecture Comprehenision: Effects of a Metacognitive Strategy." 

Applied Educational Psycfto/ciy 16(19^): 155-^. 

Larkin, J, H,, and Reif, F. **Anal3^i8 and Teaching of a General Skill for Studying 
Scientific Test" Jounud of Educational Psychology 68(1976): 431^. 

Leinhardt, G. A. Math Lessons: A Comparison of iSqoert and Novice Competence. 
Pittsbuiigh, Pa,: Learning Research and Developing Center, University of Pittsr 
burgh, 1^. 

Nolte, R. Y., and Singer, H. "Active Comprehensive Teaching: A Process of Read- 
ing Comprehension and Its Effects on Reading Achievement." TTie Reading 
Teacher 39(1985): 24^1. 



46 



ERLC 



5o 



Using Scaffolds for Teaching 



Palincsar, A. S, "Collaborating for Collaborative Learning of Text Comprehen- 
sion.'' Paper presented at the annual conference of the American Educational 
ResearchAs^xiation, Wa^iingtQn,D.C., Aprfl 1987. 

Palincsar, A, S., and Brown, A. L Tledprocal Teaching of Comprehenaon-Foster- 
ing and Comprehension-Monitoring Activities.* Cognition and Instruction 2 
a984): 117-^75. 

Paris, S, G. ; Wixson, K K; and Palincsar, A S, instructional Approaches to Read- 
ing Comprehension.'' In Review (^Research in Ediuxttion, 13, edited by E- Z. 
Rothkof. Washington, D.C.: American Educational Heseaxxii Association* 1^. 

Raphael, T. E., and Pearson, P, D. Increasing Student Awareness of Sources of 
Information for Answering Questions.'' American Educational Resecuvh Jour- 
nal 22 {1985) 217-^7 . 

Rii^hart, S. D.; Stahl S- D.; and Erickson, L. G. "Some EflFects of Summarization 
Training on Reading and Studying." Reading Research Quarterly 22 (1986): 
422^. 

Rosenshine, B., and Berliner, D., eds. Explicit Teaching: Talks to Teachers. New 

York: Random House, 1987. 
Rosenshine, B., and Stevens, R. Teadiing Functions*'' In Handbook ofResmrvh on 

Teaching, 3d eA, edited by M. C- Wxttrcv k. New York: Macmillan, 1986. 
Scardamalia, M., and Bereiter, C. ^'Fostenng the Development of Self-R^fulation 

in Children's Knowledge Processing." In Thinking and Learning Skills: 

Research and Open Questions, edited by S- F. Chipman, J. W. Segal, and R. 

Glaser. Hillsdale, N J.: Lawrence Erlbaimi Associates, 1985. 
Schoenfeld, A. Mathematical Problem Solving, New York: Academic Press, 1985. 
Singer, H., and Donlon, D. ^'Active Comprehension: Problem-Solving Schema with 

Question Generation of Complex Short Stories,"" Reading Research Quarterly 

17(1982): 166^. 

Taylor, E., and Frye, B, **Skills Pretest: Replacing Unnecessary Skill Activities 
with Pleasure Reading Comprehension Strategy Instruction." Unpublished 
manuscript CoU^e of Education, University of Minnesota, 1988. 

Tobias, S, "When Do Instructional Methods Make a Difference?" Educational 
Researcher 11(1982): 4^10. 

Vygotsky, L. S. Mind in Society: The Development of Higher Psychological Pro- 
cesses. Cambridge, Mass,: Harvard University Press, 1979. 

Wood, D. J.; Bruner, J. S,; and Ross, G. The Role of Tutoring in Problem Solving " 
Journal of Child Psychcd^^ and Psychiatry 17(1976): SS-^lOO. 

Wong, Y, and Jon^, W. Tncieasing Metac^mpreheaision in Learning Disabled 
and Normally Achieving Students Through Self-Questioning Training." Learn- 
ing DisabUity Quarterly 5(1982): 228-^9. 



ERIC 



47 




Students as Researchers and Teachers 

Ann L. Brown and Joseph C. Campione 

School traditions i^Bt evolved as means of educating some of our stu- 
dents are Hi-matched with the needs of the 21st century, when the 
demand is to educate all children. Educational practices that generated 
an educated elite cannot simply be grafted to serve an increasingly 
diverse and ill-prepared student population. Schools must change, 
because the clientele of ^rhools is changing. 

Not only are the clients of schools changing, but so too are the forms of 
literacy required to find a plac^ in the work for<^. Literacy includes more 
than simple rote acts of reading and calculating. Increasin^y, graduates 
should be able to critically evaluate what they read, express themselves 
clearly in verbal and written form, imderstand mathematical procedures, 
and be comfortable with various forms of technology that can serve as 
tools for learning. 

Although virtually everyone recognizes the need to foster higher order 
thinking, considerable debate exists about how to achieve this. The first 
area of controversy concerns whether to teach thinking skills in the con- 
text of academic study or as a separate course. Although both can be 
effective, we favor instruction in the context of regular academic courses. 

A second controversy has been provoked by the use of the term *lii^er 
order thinking skills" to describe reasoning. Higher order thinking skills 
are often contrasted with basic skills, leading to the i^iwption that the 
former are not for all. Younger and more disadvantage students are held 
accountable for basic skills, whereas higher order thinking skills are seen 
as part of upper school curricula or, worse still, as optional extras. 

This latter view stems from stage-like theories of development which 
purport that young children do not have the resources to engage in higher 
forms of thinking. If there is one thing that recent research in cognitive 
development has shown, however, it is how far fi*om the truth that notion 
is. Given a supportive context, very young children seek causes for 
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actions, generate and evaluate explanations of phenomena that interest 
them, and try to understand new situations by i^course to analogy from 
earlier experiences. We would argue that these capabilities should be 
built on and reinforced from the outset of schooling, that thinking and 
reasoning should part of the cuiriculirai fi^m the earliest years, and 
that it should be for all students. For this reason, our work on improving 
reasoning skills has b^n primarily with academically at-risk students* 

For several years, we have studied the reading comprehension activi- 
ties of academically nmnginal diildren. The decision to target reading as a 
domain in which to foster critical thinking followed fit)m two pragmatic 
considerations. First, it is failxire in reading that singles out children for 
labeling and remedial intervention, along with all that entails. If one 
<»uld "inoculate** students against academic failure by enhancing reading, 
the result might be that their future academic trajectories would prove 
more promising. 

Second, disadvantaged students, perhaps becatise of their greater need 
for basic skills instruction, are more likely to be subjected to practice in 
disaggregated skills that lacK meaning and coherence. Comprehension 
practice is rarely provided Given that studente caxmot perfect what they 
do not practice, our aim has been to provide that practice. 

In this chapter, we will describe the history of our research program on 
reading to learn in a variety of contexts. We be^m by considering the tra- 
ditional reading group as the context of thinking instruction, but became 
increasingly dissatisfied with this setting as a thinking forum for older 
studente. In our more recent work, we have concentrated on classrooms 
as commimities of learning in which critical thinking is practiced in the 
service of learning science. 

Fofiteiing Beading Comprehension via Reciprocal Teaching 

We have been involved for almost a decade in a program of reciprocal 
teaching for promoting reading comprehension. Although om: own work 
has been conducted with middle school students, many replications have 
been made with high school and junior wllege students. Rmpiwal teach- 
ing is a procedure that features guided practice in applying simple con- 
crete strategies to the task of text comprehension. A teacher and a group 
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of students take turns leading a discussion about material they have read 
silently. 

The leamii^ leader (student or teacher) b^ins the diwussion by asking 
a question and ends by summarizing the gist of what has been learned. In 
the fsL(^ of disagreement or misunderstanding, the group rereads and dis- 
cusses possible questions and summary statements until it reaches con- 
sensus. 

Questioning provides the impeti3s for discussion. Summarizing at the 
end of a period of discussion helps students establish where they are, in 
preparation for tackling a new segment of text. Attempts to clarify any 
comprehension problems that might arise occur opportunistically when 
someone misunderstands, or doea not know the meaning of a concept, 
word, phrase, etc. Finally, the leader asks for predictions alK)ut future 
content if this is appropriate. 

The cooperative nature of the procedure is an essential feature- The 
group is responsible for imderstanding and evaluating the text. All mem- 
bers of the group, in turn, serve as learning leaders (the ones responsible 
for guiding the dialog) and as learning listeners (whose job is to encour- 
age the discussion leader to explain the content and help resolve misun- 
derstandings). The reciprocal nature of the procedure forces student 
engagement; and teacher mc^eling provides examples of expert perfor- 
mance. 

The reciprocal teaching program has been used successfully as a read- 
ing comprehension intervention by average classroom teachers with aca- 
demically at-risk elementary and middle level children. For example, 
between 1981 and 1987, 287 junior high school students and 366 first to 
third grade children took part in reading and listening comprehension 
experiments. The teachers worked with small groups. (The ideal group 
size is six, but teachers have handled much larger groups.) 

Students enter the studies scorii^ approximately 30 i^rcent correct on 
independent tests of text comprehension, and we count as successful any 
student who achieves an independent score of 75-80 percent correct on 
five successive tests. With this criterion, approximately 80 percent of the 
students in both age groups were judged to be successfiil- Furthermore, 
students maintained their independent mastery for up to a year after 
instruction ceases. 



=_ ^ 51 



Teaching and Ass e s s m e n t 



The reciprocal teaching procedure provides students with widely 
applicable thinking tools. Perhaps the most dramatic indication of the 
efifects of redprocal teaching is the estent to wfaidi the students improved 
in settings other than those we control. We have repeatedly fbimd three 
types of learning transfer imprompted generalization to content area 
classroom settings; improved performance on post*tests that tap the 
trained strategies; and substantial improvemoat (an average of two years) 
in standardized test scores. The program now is in widespread use 
nationally. 

Reciprocal Teachiiig of Coherent Content 

In the m^ority of our work on reciprocal teaching of reading compre- 
hension, we have followed the typical *Yeading group" practice. Each day, 
students read a text that is tmrelated to the previous texts. Passage 
follows passage with no coherent link between them, allowing little 
opportimity for cumulative reference, little opportunity for learning. The 
students are learning to read rather than reading to leara And this is the 
main agenda of reading group activities. 

In contrast, learning about history or science demands reading of 
coherent content that builds successively on prior reading. This enables 
students to accumulate progressively richer knowledge and to apply 
principles of learning based on analogy, example, explanation, and 
plausible reasoning. 

We have found that the seemingly minor modification of introducing 
connected texts that concentrate on an organizing theme has improved 
student performance in reciprocal teaching. Reciprocal teachii^ featuring 
organized materials enables students both to learn a body of coherent, 
usable content, and to develop a repertoire of strategies that will enable 
them to learn additional content on their own. Our next step was to 
embed reciprocal teaching in science classes. 

Reciprocal Heaching in the Science Class 

Discussion: Kelp Keeps Everybody Happy 

Student 1: Why do s^^ientists think most of the sea otters will die? 
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Student 2: Because they live mostly in that section. So when the oil gets on 
ti^ ftir. tl^rll sink or get too ccA± And it gets in thcdr stomadis 
where they try to lick themselves clean — or drown or ^mething. 

Students: (Clarification) We're missii^ the boxing old chain stuff! 

Student 1: We're getting there. 

Student 4: {Explanation) OU kills otters, otters eat sea urchins^ sea urchins 
eat kfilp- Kelp keeps everyone happy. Take out otters, and you*ve 
got one of those broken links. Too many of some — not enough of 
aiH>ther. 

Student 2: (Clarification) Another pn^Iem, it says here, is the oil on top of 
the water makes it dark. IVb dark, and the sun can't get in, so it 
doesnt grow,— What doesnt grow? 

Student 3: (Summary) The plankton is hurt becauj^ it has no sun for ener- 
gy, so the shrimp's not fed and the tuna's not fed, because it eate 
the shrimp, and so on in a drcle — or a web? 

Student 1: (Prediction) I predict that all of the otters and other sea life will 
be endangira^ if this goes on. 

The above is a typical discussion betw^n four sixth graders discussing 
material they have prepared about the Exxon Valdez oil spill in a recipro- 
cal teaching period in their environmental science class. 

The reason we choose to look at higher order thinking in the context of 
science education is that science plays a very minor part in elementary 
school and junior high, too often displaced by extra practice in basic skills. 
Indeed, relatively few students receive adequate scientific education even 
in high school, and those most poorly served are women and minorities. 
Somehow, schools (X)nvey the message that mathematics and science are 
"'white male** domains, and interest in these areas among other groups 
declines during the middle level. 

Even when scxen^ is introduced in middle level and high school, the 
emphasis is on breadth, rather than depth, of knowledge. Students are 
exposed to a vride array of facts and definitions without the opportunity to 
explore a theme in depth, or to consider the relationships among the bits 
and pieces to which they are exposed Even innovative science curricula 
are often transforms! into **hands^n'' activities requiring little thougjit 
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In addition, there is an almost slavish concentration on observational 
checks and balances, rather than consideration of alternate theoretical 
points of view and different perspectives. The consequence is a lack of 
opportunity to practice critical Ui^king and reasoning skills, along with a 
fiauhy notion of what science is. 

To alleviate these pnAlems, we set out to design a curriculum for sixth 
to ei^th graders that would exjwse the students to science without over- 
simpKfying the material until it was inteUectually empty. We bIso assumed 
that in the process, the students would ino^earo their reading, writing, and 
t>itnlringflldllfl. One cannot think critically in a vacuum. Cciierent scientific 
inquiry provides a fertile ground for promoting Uteracy skills in general 

We developed a year-long environmental science curriciilum based on 
the xmderlyii^ themes of interdependence and adaptation. Although we 
wanted depth over breadth in covers, we did not want to introduce bio- 
chemical substrata to children this yountg. Instead, the students were 
invited into the world of the nineteenth centtiry naturaUst to do library 
research, conduct hands-on experiments, participate in field trips, and 
engage in various forms of data collection and analysis aroimd central 
repeating tiiemes. Central them^ included the ncxtions of balance, change, 
adaptation, competition and cooperation, species and populations, and 
predator/prey relations that are central to an understanding of ecosys- 

The cx>^xrse includes three main units, each with five subunits, to sup- 
port collaborative learning activities: changing populations (extinct, 
endangered, artificial, assisted, and urbanized); food (produdi^, consum- 
ing, recycUng, distributing, and energy exchange); survival (reproduction, 
defense mechanisms, protection firom the elements, ecological niches, and 
(X)mm\mities), 

The Collaborative Classroom 

Although the topic and themes were provided by us, the students were 
responsible for doing their own research within those guidelines. They 
worked in CMK)perative groups based on the Jigsaw method. Students 
formed five research groups, each assigned responsibility for one of five 
subtopics of each content area unit Th^ prepared books on their research 
areas using HyperCard and Microsofl: Word. Next, they regrouped into 
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learning graui» where one member of each group was an expert on one- 
fifth of the material This expert guided reciprocal t ea chi n g ^minars on 
that material 

In these classrooms, students were involved in extensive reading to 
research their topics; writing and revision to pnxhice booklets fitsm which 
to teach as well as to publish in dass books covering the entire topic; and 
computer use to publish, illustrate, and ^t their booklets. They were 
reading, writing, and using computers in the service of leamii^. 

Technology 

These classrooms had the support of sophisticated, state-of-the-art tech- 
nology, including computers and video materials. But two important 
points must be made. The technology is nic» but not necessary. It reli^ 
on commercially product and stable software capable of r unning on rela- 
tively inexpensive machines. 

It was designed to simplify student access to research materials, in- 
cluding books, magazines, videotapes, and videodiscs; support writing, 
illustrating, and revising texts; allow for data storage and management; 
and enable easy commimication within and beyond the classroom. (For 
details, see Brown and Campione, in press.) 

The collaborative research classroom was successful on many fronts. 
First, as with studies concerned directly with reading, reading compre- 
hension improved in both poor and average readers. Similarly, student 
writing improved dramatically. In fact, comparing the changes in our best 
students over a yef or, we estimate that they progressed firom poor grade 
school levels to using organizational structures more typical of young 
adults. 

The students also showed substantial gains on short-answer questions 
covering their knowledge of the ciirricular content. Research students 
outperformed comparison groups with equal exposure to the material. In 
tests of application and transfer, the research students most clearly out- 
performed control groups, demonstrating their ability to apply biological 
principles to novel tasks such as creating an animal to fit a habitat or 
designing a self-sufficient space station. 

In general, both in terms of in-depth analyses of on-line processes 
(dialogs, planning, designing instruction) and outcome measures of basic 
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literacy, the collaborative research classroom was successful. The improve- 
ment in reading and writing scares when the activities were practiced in 
learning scientific (intent is particularly important, given the reluctance 
of administratora to permit %oo much science'* in the early grades because 
of the need to improve reading scores- Sudi activiti^ wntribute to, rather 
than detract from, the acquisition of basic literacy. 

Open-Ended Tests 

Currently, considerable interest exists in the development and use of 
alternative forms of assessment One of our goals in designing a learning 
environment was to provide opporttiniti^ for in-depth assessment of stu- 
dents' reasoning. And, in fact, the collalK)rative classroom does provide 
multiple sources of such assessments as an automatic b)T)roduct of typi- 
cal student activities. 

For example, we can evaluate students' scientific inquiiy skills as they 
plan and carry out actual exj^riments. We can assess students' scientific 
conceptiona/misconceptions, explanations, causal reasoning, tise of analo- 
gy, etc., as they endeavor to teach their peers. We have notes and com- 
ments students make about each other's work. We can analyze the initial 
and revised books that students use to buttre^ their teaching. 

Over time, students build up a portfoUo of their laboratory and writing 
efforts. They are asked to identify what they see as their best work and 
submit it for evaliiation and pubUcation. The environment generates mul- 
tiple sources of assessment, the m^ority of which are produced by stu- 
dents, not as responses to set tests, but as automatic consequence of their 
participation in the classroom c»mmunity. 

A Commimity of Learners 

Asking students to form a research community in which they are respon- 
sible for their own and others' learning encouraged them to feel a sense of 
ownership for the knowledge they were acquiring. Within these commu- 
nities, reading, writing, and thinking took place in the service of a recog- 
nized goal: learning and helping others to learn about a topic that deeply 
concerned them . 

To illustrate how these collaborative learning classrooms diverge from 



Students as R e s e a r c h e r s a n d Teachers 



traditional practice, let us conclude by comparing them with what hap- 
pens in the traditional reading group. In a reading group, tochers assign 
the text; they dde reading tasks out in small pieces; and students must 
read on demand 

This is in sharp contrast to how literate adults read So too, this prac- 
tice is in contrast to our collaborative learning environment, where chil* 
dren read in order to write tJie texts» working at their own pace, ^th 
extended involvement in personally chi^en projects. 

Another strange asp^ of reading lei^ns is that stiidents usually read 
in order to prove to the teacher that they have read; to answer questions 
posed by the teacher, who already knows the answer. The teacher is also 
the primary consmner of any written products. But in our classroom, stu- 
dents read in order to understand communicate, teach, write, persuade, 
etc- Students answer their own questions and are accountable for the 
quaUty of the questions asked 

Teachers do not always know the nght answer. The goal is reading, 
writing, and thinking in the series of learning about something of per- 
sonal interest. Teaching is on a need to know basis, with experts (be they 
children or adults) acting as facilitatoi^. 

Student expertise is fostered and valued by the commxmity. This con- 
trasts sharply with what usually goes on in reading and in science 
lessons. These changes result in significant improvements, both in the 
students' thinking skills and m the content area knowledge about which 
they are reasoning. 



Note: The research reported in this chapter was supiK)rted by awards from the 
James S. McDonnell Foimdation, the Andrew W. Mellon Foundation, and the Eve- 
lyn Lois Corey Research Fund. Partions were adapted from Brown and Campione 
(1990), "Commimities of Leamii^ and Thinking,** in D. Kuhn (ed.), Contributions 
io Human Ihvelopment 21(1990): 108-25, and from A. L, Brown and J. C. Campi- 
one, (in press). Also, Tlestnictiiring Grade School Learning Environments to Prx)- 
mote Scientific Literacy,** a paper prepared for the Summer Institute, Cotmcil of 
Chief State School Oificers, 1990. For details of reciprocal teaching, see A. L. 
Brown, and A- S. Palincsar, "Guided Cooperative Learning and Individual Knowl- 
edge Acquisition.'' In Knowing, Learning, and Instruction: Essays in Honor of 
Robert Gta^n edited by L. B. ResnicL Hillsdale, NJ.: Erlbaum Associates (19M). 
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Diagnosing and Augmenting 
Basic Cognitive Skills 

Charles A Letteri 

They come to school as if eveiy Monday was their first Monday!" Sound 
familiar? Everyone concerned with students has experienced the 
'TVfonday Morning Syndrome.*' 

Why is it tiiat some students learn the first time through; others re- 
quire prolonged^ repeat^ coaching; and others never seem to learn at all. 
We are not speaking here of students with severe learning problems or 
with genetic d^dts, disease, or trauma. On the contrary, students witli 
Monday Morning Syndrome are ""r^ular kids," who come to school each 
day, on tiine, with most of their assignments completed. They are not 
discipline problems. They are reasonably well groomed, and they are 
cooperative. 

These students, r^ardless of our best efiforts, never seem to be able to 
make it on their own. They r^uire help on a continuous basis. They are 
never ^pable of transferring information and skills from one section of 
the ctxrriculum to the next (even in sequential subjects such as math). 
These students, along with those who always fail, form the mfl\jority in 
our classes. 

What separates these students from those who excel? What distin- 
guishing factors account for a student not able to learn and perform 
beyond the minimum requirements? Current cognitive-based research 
demonstrates that one of the most important factors contributing to 
achievement differences is the profile of cognitive skills that a student 
brings to academic tasks (Letteri, -1991). 

To succeed, a student must possess a repertoire of thinking skills that 
meet the cognitive demands of learning and performan<^ tasks. Without 
appropriate cognitive skills, students can never be self-directed and inde- 
pendent in academic tasks. 
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One means of assessing the salient skill levels of difierent students is 
the Cognitive Profile- This Profile is a combination of seven specific, inde- 
pendent, performance measures of cognitive skills found to predict levels 
of achievement in all areas of academic learning and performance. The 
NASSP Learning Style Profile also provides group measures of fom of 
these cognitive skills (Keefe et al., 1986). 

In this chapter, we will examine the Cognitive Profile as an as^ssment 
instrument for diagnosing learning difficulties, its use in designing indi- 
vidualized "Augmentation" (ct^nitive rem^ation) programs, and its role 
in a Cognitive Ba^d Instructional System. In addition, we will examine 
the Cognitive Based Instructional System as a basis for educating stu- 
dents in the most important and in-demand role of the 21st century: the 
"SymboUAnalyst" (Reich, 1991), 

Learning as a Cognitive Based System 

Information about how students learn and perform in academic tasks 
comes firom research on ojgnitive rontrols and their effect on the human 
information processing system. This research descril^ learning as a cog- 
nitive system involving the perception, reception, processing, storage, and 
retrieval of infonnation by the human brain (Travers, 1982). Because the 
processing of information by the brain is a system, we must ask some 
important procedural questions: 

■ What structures and operations of the system are required for aca- 
demic learning and performance? 

■ How can a student's ability to monitor, direct, and (X)ntrol the system 
be assessed? 

■ How can a student learn to monitor, direct, and control the system's 
structures and operations for use in academic learning and perfor- 
mance? 

■ How can Cognitive Based Instructional Systems be utilized to address 
the cognitive requirements of academic learning and performance 
tasks? 
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All educators want all stiidents to be able to learn and use infbnnation 
from various subject areas. And yet, for all our efforts, we have students 
who cannot learn, who are academic failures, and for whose learning 
problems we have had no profitable answer. Fortxmately, however, we 
can measure, identify, and profile the cognitive skills of Uiese students. 

Educators can be trained to analyze student Cognitive Profiles and to 
intervene directly to remediate the identified deficit. Students can be 
trained in new learning skill stoat^es, and in the transfer and applica- 
tion of th^ skills to learning and j^rformance tasks. This training and 
tranrfer program is call Alimentation (Letteri, 1991). 

Cognitive Profile Assessment and Augmentation enable teachers to 
direct instructional efforts at the core of the learning disabilities prob- 
lem — deficits in the specific o^nitive skills required by academic learning 
and performance tasks. Too many educators assiraie that all students 
know how to learn; that they pc^s^ the jm^e of cognitive skills required 
to process academic information; and Uiat to be sua^ssfiil they only need 
more motivation, more time on task, more computers, more aides, etc 

Research in a^nition clearly demonstrates, however, that learning dis- 
abled students lack the basic cognitive skills to monitor, direct, and con- 
trol their information processing operations in a manner required for 
learning and performing academic tasks (Letteri, 1980). 

Learnmg: A Cognitive Definition 

Learning is an activity of the mind that involves performing specific, 
directed, and controlled operati(ms on new information that results in it 
becoming part of the knowledge structure in the student's long-term 
memory (Letteri, 1988). 

Learning is not automatic. It r^uires sustained and directed effort on 
the part of the student. For learning to occur, the student must possess 
the operations and structures needed to learn. Learning problems and 
disabilities are not necessarily related to the complexity of the subject 
matter, nor the student*s predisposition to that subject. Most learcdng 
problems are related to student deficits in the specific cognitive skills 
required to learn and to use that subject matter. These specific cognitive 
skills are called cognitive controls. 
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Cognitive controls play a significant role in determining student suc- 
cess in academic leamii^ and perfonnanre* Cognitive a>ntrols are basic 
thinking skills that students can learn, or be trained to use, to monitor 
and direct the operations of their information processing systems. The 
result of this omtrol is a proce&dng system that i^rfiinns in the manner 
that the student and ^e aca&mic tas^ d^nand (Lett^ 

Many students do not know how to a>ntrol their information process- 
ing systems (or that contttd is even pos^le). Learning and performance, 
for them, is a chance and happenstance occurrence. These students have 
great difficulty placing new information, in an int^rated and organized 
fashion, into existing knowledge structures in tiieir long-t^m memory. 
Learning is difficult (or imposdble) for them because of the disorganized 
and unstable structure of thdr existu:^ infoimaticm* 

New information becomes similarly disox^anized and imstructuired, 
rendering it usel^ as the foundation for additional learning or task i^- 
fonnance. Chi the other hand, students who have mastoied their cc^ 
controls have highly organized and a^sessible structures of knowle^pe in 
long-term memory that serve them for additional learning and perform- 
/ ?Ticreasii^ levels of excellence. 

< > Cognitive Control 

{:Km^ -11 indicates that cognitive controls are the basic thinking skills 
ihsd ijeparate the exr f >jit learner from the mediocre and disabled learn- 
er. Altiiough the gen/ i operations of the information processing system 
are available to adl st(\dents (though not always used), the cc^nitive con- 
trols must be learned. Students must be made aware of these skills and 
trained in their performance before they can successfully apply them in 
learning and performance tasks (Letteri, 1985). 

Cognitive control research has identified seven controls that are signif- 
icantly related to the description and prediction of levels of student aca- 
demic achievement. Each control has a separate assessment, and the 
results are plotted on a chmt called a C(^nitive Profile. Individuals of all 
ages can be assigpoed to one of three Profile Typ^ (Letteri, 1980). 

■ Type One Profile: Students who evidence strength in a m^'ority 
(four or more) of the controls are always in the top 15-18 percent of 
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Cognitive Profile Chart 1 



Compu-U-Think 



Dr. C. A. Letteri 



Cognitive Profile 
Subject W #4 
Types 




Age: 13 
Sex: Female 
Grade: 8 

Standard Test Scores 

Verbal: 12 

Language: 11.1 

Math: 9.4 

Reading Comp: 11.6 

WorWStudy: 11.4 

Composite: 1 1 .1 

Cognitive Profile Type: 1 



the population in academic achievement. 

■ Type Two Profile: Students whose profiles reveal no particular 
strengths or weaknesses in cognitive control or are highly inconsistent 
tend to be average (mediocre) in academic achievement. Type Two Stu- 
dents comprise ®)-70 percent of the population. 

■ Type Three Profile: Students whose profiles reveal weakness in a 
niajority (four or more) of the controls make up the bottom 15-18 per- 
cent of the population in academic achievement. Our research clearly 
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Cognitive Profile Chart 2 

Compu-U-Think 



Cognitive Profile 
Subject: W #8 
Types 



Test 


1 


2 


3 


Complex 


□ 


□ 




Sharpener 


□ 




□ 


Tolerant 


□ 




□ 


Analytic 


□ 


□ 




Narrow 


□ 


K 


□ 


Focus 


□ 


□ 


> 


Comparative 


□ 




□ 



Dr. C. A. Letteri 



Age: 13 
Sex: Female 
Grade: 8 

Standard Test Scores 



Verbal: 


7.6 


Language: 


6.5 


fVlath: 


7.6 


Reading Comp: 


7.4 


Work/Study: 


7.5 


Composite: 


7.3 



Cognitive Profile Type: 



indicates that the controls are the m^or factor in the levels of student aca- 
demic achievement (Letteri, 1991). 

Following is a brief description of each of the seven rantrols and the 
skill it measures. 

■ Complex: Narrow is concerned with the accuracy of adding to and 
storing information in one category of long-term memory. Complex is 
concerned with the structure and relationships among all the cate- 
gories of information in long-term memory and their use in academic 
learning and performance. This skill is required to view information 
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Cogni^ Profiie Chart 3 



Compu-U-Think 



Dr. C. A. Utteri 



Jognltiv© Profile 
Subject 0193 
Types 



Test 


1 


2 


Complex 




□ 


Shafpener 


□ 


□ 


Tolerant 




□ 


Analytic 


□ 


□ 


Narrow 


□ 




Focus 


□ 


□ 


Comparative 


□ 


□ 



□ 

□ 
□ 
a 
o 



Age: 11 
Sex: Male 
Gmde: 6 

Standard Test Scores 

Vert>al: 

Language: 

Math: 

Reading Comp: 
Work/Study: 
Composite: 



4.4 
3.4 
3.b 
4.9 



4.2 

Cc^nltive Profile Type: 3 



or problems from multiple perspectives. 

Sharpening: The skill required to maintain distinctions between indi- 
vidual concepts and structures of concepts in order to avoid overlap- 
ping and confusion among them. Included are the mnemonic systems 
to structure and maintain infonnat on in long-term memory in clear, 
stable, and accessible formats. 

Tolerance: The skill required to engage and examine apparently 
ambiguous information for purposes of modifying existing structures of 
information and to accommodate new ioformation vdthin these related 
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Cognitive Profile Chart 4 

Grade Si?tjAverage Standard Scores By Profile Types 




TYPE1 



TYPE 2 



TYPE 3 



Verbal Lang 



Math 



Read 



Comp 



structures. This skill is involved in problem recognition, identification, 
and solution (Mnstruction. 

■ Analytic: The skill »«quir^ to segmeaat complex information into com- 
ponent parts for purposes of identification (naming, labeling), estab- 
lishing appropriate relationships t^twten the components, and deci- 
sions related to fiuther processing. 

■ Narrow: The consistent use of a complete and acaurate list of param- 
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eters to judge the placement of new information in the structures (cate- 
gOTies) of long-tCTm memory. 

■ Focusing: The skiU r^iiired to selectively attend to the relevant (im- 
portant) components of the information or task without being dis- 
tracted by irrelevant (imimportant) components. 

■ Cornvarative Analysis: The skiU required to sel^ a ojrrect response 
or problem solution from among several highly similar but not identi- 
cal alternatives. The skill to perform a highly accurate and properly 
ordered and directed comparison betweeu two or more elements of 
information and to determine and state the basis for similarity and 
difference. 

Each of the cognitive rontrols can be assess^ and trained individually, 
but in fact, they work in rancert dtxring the processing of information. 
These controls are a part of existing long-term memory. They are used to 
monitor, direct, and control the flow of information from the perceptual 
registers (e.g., eye, ear) to placement in relevant staructures of long-term 
memory, and for later recall (or r^ronstruction) in learning, problem solv- 
ing, and related performance tasks (Letteri, 1991). 

If there is a problem with any of these controls (i.e., Type Two and 
Type Three students), increments in strength and associated Type 
changes can be made through individually designed Augmentation and 
Transfer Programs. Research has demonstrated impressive increments in 
the academic achievement of students in Augmentation programs (Lret- 
teri, 1991). 

For example, students having learning problems with mathematics, 
science, or reading can be helped by specific attention (among others) to 
the controls of analysis, focusing, and comparative analsrsis. 

■ Analysis: Math problems can be segmented to reveal important ele- 
ments such as symbols (and their definitions), facts, and relationships 
among these symbols and facta. Maps can be segmented into compo- 
nents such as political borders, navigational symbols, roads, and geo- 
graphic symbols in order to arrive at place locations and designations. 
Word problems can be segmented Into components to determine the 
relative importance and the relationship among chese components. 
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■ Focusing: In doing math word problems, student often attend to the 
story first, and then to the matli elements. This process distracts stu- 
dents and in many cases causes them to miss elements essential to 
problem identification or solution. In reading either literature or sub- 
ject matter, attention must be (^mipletely deployed (and mimitcnr^) to 
the scanning of the words, lines, and paragraphs. If attention wan- 
ders to a symbol, graphs or picture on the page while this scanning is 
occurring, the students can miss essential words, or fail to tra^ firom 
one line to another acxxurately. They can miss words or other S3rmbols 
essential for comprehension. Comprehension will inaccurate. 

■ Comparative Analysis: The (X)mparative process r^uires that the stu* 
dent first use analysis to identify the elements, and then focusing to 
identify specific elements to be used in the wmparison. The results of 
the comparative prcnress are statements (rule-relationship) that con- 
tain the elements of similarity as well as the elements of difference 
(distinctive features). These statements become the rules that are 
applied durix^ subsequent learning or performance tasks to deter- 
mine cat^ory inclusion or amxrate identification. These rules are the 
basis for the (instruction of problem solutions. 

Cognitive Based Instructional Systems (CBIS) 

Augmentation and Transfer Programs are designed for individual and 
small-group remedial instruction. Cognitive Based Instructional Sj 
terns are designed for use with a whole class or group of classes, within 
one or more content areas. Using CBIS, the teacher can analyze the con- 
tent and determine the cognitive requirements for class success in 
assigned learning and performance tasks. The teacher can then train the 
students in the identified skills and how to apply them in the assigned 
tasks. 

These cognitive requirements include the basic cognitive controls as 
well as more advanced elements of thinking such as concept attain- 
ment, concept formation, mnemonics, problem recognition, identifica- 
tion and solution construction, symbol analysis, and manipulation. 
These cognitive skills are an integral part of even the most elemental 
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learning and performance task 

They are even more important in computer-based learning/perfor- 
mance pn^rams. In fact, computer literacy presupposes these skills and 
that the stwlent is well practiced in their applications across content area 
learning and performance tasks. 

Cognitive Based Instructional Systems aim to provide students with 
the most basic, transferable skills a school can offer: the ability to ana- 
lyze content and problems, and to determine what is required for suc- 
cessful completion of associated tasks. These skills can best be learned 
through a problem-oriented curriculum, with active student participa- 
tion in collaborative problem -solving groups. Schools must be restruc- 
tured to support this kind of cognitive-based learning. 

Only the schools can prepare students for the new roles and tasks of 
a twenty-first century information society. An information society is 
characterized by ever-increasing, accessible, and raanipulptive sources 
of information. Every person at every location and position will have 
direct access to any kind of information he or she requires. The state of 
information, its location, its format and acc^s codes, will be available to 
all individuals. What to do with this information, how to select from the 
array of information, and how to apply it to a variety of problems must 
be the concern of the educator (Reich, 1991). 

The ability of students to recognize, identify, and solve problems will 
become increasingly dependent on their ability to manage and manipu- 
late information symbol systems. Students must become ^'symbol ana- 
lysts,'' A symbol analyst knows how to access the meaning of symbols 
as well as the strategies and operations that make those symbols effec- 
tive in a variety of task completions, including problem solving. Sym- 
bol-analyzers will have direct access to established bodies of knowledge 
(i.e., facts, codes, formulas, and rules). What will be more valuable, 
however, will be their capacity to effectively and creatively use the 
knowledge. 

Symbol analysts will solve, identify, and broker probleniS by manipu- 
lating symbols. They will get behind a problem and examine reality 
from multiple perspectives in an attempt to visualize new solutions. 
The capacity for discovering patterns and meanings is the essence of 
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the symbol analyst, who simplifies reality into abstract images that can 
be rearranged, juggled, and experimented with. To l^^me symlx>l ana- 
lysts, students must be trained to examine how problems come about, 
how they are connected to other problems, and how to experiment to 
discover new solutions (Reich, 1991). 



Educating the Symbol Analyst 

■ Content: Training the s3rmbol analyst is now in the hands of a few 
elite institutions and a>riK)rate training programs. The demand for 
elite symbol analysts is iiK^reamng* Cognitive Based Instructional Sys- 
tems directly addr^ the education needs of i^Tnbol analysts throu^ 
a Problem-Ori^ted Curriculum. 

In this curriculum, the student is presented with problems involving 
increasing levels of difficulty and complexity that must be solved 
through the manipulation and management of information symbols 
common to a variety of knowledge structures. The teacher trains the 
student in symbol manipulation and management t^hniques, as well 
as in Jab related Mgnitive strategies to support successful solutions. 
Both learning procediures and solution proredures are int^prated into 
the curriculimi. Content indudes both the information and the strate- 
gies and structures required for successful learning and performance. 

■ Cognition: Currrent educational practice delivers content in separate 
fields such as mathematics, science, history, or literature. But it fails 
to teach the thinking processes that enable students to use the con- 
cepts and methods of those fields, esf^ally in problem-solving tasks 
(Reich, 1991), 

In other words, current education does not teach the underlying cog- 
nitive management and manipulation skills required to identify and 
solve problems. Teachers must examine content and associated prob- 
lems to determine the cognitive requirements for learning and using 
that content. These requirements must then be incorporated into the 
lesson to ensure that students have both the content and the cognitive 
skills needed for success. 

■ CoTitext: When Content and Cognition goals are achieved, the Context 
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of the classroom dramatically changes because students have the rag- 
nitive skills for learning and usii^ information. Hie context changes to 
one of cooperative/shared learning and performance, wherein students 
work in rallaborative teams and the teacher serves as a mentor and 
coach. 

Learning and using information involves various problem-solving 
situations. In the oc^gnitive-bas^ classroom (or sdiool), the student is 
no longer isolated aiid independent, but a imrt of a team tliat includes 
teachers and all other available resourros. In addition, leaiming and 
performance extend well beyond the a>nfin^ of the school. 

■ Global Perspective: If education is to assist students in becoming 
knowledgeable and contributing members of society, a more global 
and interdependent view of society must prevail. 

It is the function and responsibility of schools to ensure that their 
graduates have the skills to add value to the ^ol^ eccmomy^ and that 
this added value will be of the hij^est cjuality. Only cognitive-based 
systems can make this possible. Nothii^ 1^ will siiflSce in the twen- 
ty-first century. 
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Assessing H^her Order 
Thinking for Accountability 

Robert H. EnnU 



Why should we be interested in the assessment of higher order think- 
ing? The answer is obvious, when we consider some of the functions 
it can serve: 

■ Diagnosing the levels of students' hi^er order thinking 

■ Giving them feedback about their thinking prowess 

■ Motivating them to think better 

■ Informing teachers about the success of tl eir teaching 

■ Deciding whether a student should enter an educational program 

■ Doing research about the teaching of and prevalence of higher order 
thinking 

■ Holding schools accountable for their degree of success in teaching 
higher order thinking. 

This last function, the accountability function, is a recent arrival on 
the assessment scene, and deserves special attention. 

The accountability movement, along with the repoi^^ng of test results 
in the local newspapers, encourages the teaching of whatever is assessed 
Correspondingly, it discourages what is not assessed. Since this relation- 
ship also holds for hi^er order thinking, aca>untability assessment, even 
with its strong intuitive appeal, can become an enemy of true education — 
when the assessment does not incoriK)rate higher order thinking. 

In this chapter, I shaD assume that accountability assessment is going 
to be a fact of life for the foreseeable future. I shall not here challenge its 
use to drive the curriculum, although this is an important issue. Ratiier, I 
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shall consider ways of dealing with some problems and issues in the 
assessment of higher order thinking. My discussion will focm on aconxnt- 
abUity assessment, but is relevant to all the assessment functions listed 
above. 

Strategies and Problems 

What can we do to make sure that higher order thinking is not discour- 
aged by the aaxmntability movem«it? Three ass^sment strategies come 
to mind: development, selection, and criticism. 

That is: When we are involved in developing accountability assess- 
ment, we can delil^rately incorporate higher onier thinking. When we 
are involved in selecting assessment prcK^ures firom what is available 
(mostly multiple-choiM tests), we can insist that the array incorporate a 
reasonable amount of hi^er order thinking. We can examine a^essment 
procedures used for accountability, noting and perhaps challenging those 
that do not incorporate higher order thinking, and applauding those that 
do. (The Illinois Critical Thinking Ptxgect is engaged in the pursuit of this 
third strategy.) 

But these strategies are not as simple as they sound; problems do 
exist: 

■ Higher order thinking is a vague concept with different meanings for 
different people. 

■ No matter how it is defined, higher order thinking is not ea^ to assess. 

■ There are difficulties in locating good assessment procedures, partly 
because of the two previously-mentioned problems. 

■ These difficulties often require that people develop their own assess- 
ment—no easy task 

■ Disagreement is widespread about whether higher order thinking 
assessment should be only siibj«rt-matter specific. 

■ Good higher order thinking assessment tends to be time-consuming 
and expensive. 

These problems are not limited to accountability assessment of higher 



ERIC 



74 



Assessing for Accountability 



order thinking. They must be faced when we are pursuing any of the 
strategies mentioned earlier. They can be solved, but solutions will not 
come easily. 

The Meaning of Hitter Order Thinking 

Bloom's Taxonomy of Cognitive Educational Objectives 

One common interpretation of higher order thinking encompasses the 
upper three levels of Bloom's taxonomy (analysis, synthesis, and evalua- 
tion), and possibly the two levels below (omiprehension and appUcation)* 
But this taxonomy was not intended by Bloom and his colleagues to be a 
list of educational objectives. It was intended as a list of categories for 
classifying educational objective. 

In any case, it is too vague to provide much guidance in deigning tests 
and other assessment pro^dures* What, for example, is analysis? The 
word covers too many radically different things, indudiog analysis of the 
political situation in the Middle East, analysis of a chemical substance, 
analysis of a word, analysis of an argument, and analysis of the oppo- 
nent's weaknesses in a basketball game. 

What teachable and testable thing do all these activities have in com- 
mon? None, except the overly vague principle that it is often d^irable to 
break things into parts. Analysis is too topic-specific to ^rve as an inter- 
pretation of higher order thinking if our piirpose is to guide the develop- 
ment of assessment procedures (and teaching procedures as well). 

Critical Thinking 

Another possible interpretation of higher order thinking is critical think- 
ing, an educational goal with a long history, but one that has aojuired a 
strong following within the last 10 years. Again, there are various concep- 
tions of critical thinking. After many years of participation in the critical 
thinking movement, I have developed this definition: ^Heasonable reflec- 
tive thinking focused on deciding what to believe or do." 

Sin(^ this definition is as vague as Bloom's taxonomy, it ne^ elabora- 
tion. I have elaborated on it in various other places, including my lK>ok, 
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Critical Thinking (in press), and in "A Taxonomy of Critical Thinking 
Dispositions and Abilities,'' in Robert Stembei^ and Joan Baron's Teach- 
ing Thinking SfdUs: Theory and Practice. 

In rantrast to some interpretations of critical thinking, my elaboration 
incorporates creative thinking. It involves identifying and examining 
one's own assumptions, but also looking at things from othera' points of 
view. It views the actual thinking process hoHstically, but identifies ele- 
ments that make up the total process, including these abilities and ten- 
dencies: 

■ Tojudge the credibility of source 

■ To identify conclusions, reasons, and assimiptions 

■ To judge the quahty of an argument, including the truth of its reasons 
and assmnptions 

■ To develop and defend one's position on an issue 

■ To ask appropriate searching questions, such as "Why?" 

■ To plan experiments and judge experimental designs 

■ To define terms in a way appropriate for the context 

■ To be open-minded 

■ To try to be well informed about the topic. 

Very important elements in this elaboration are the criteria for making 
the judgments required by the abilities and tendencies. The elaboration 
and the criteria appfy acrt^ subrject matter ar^is, but allow for differences 
between subject matter. The elaboration assiunes that knowledge of the 
subject matter is essential for making a good judgment, but not that full 
knowledge is a prerequisite for learning sdxnit thinking in a subject. Nor is 
the elaboration overly skeptical, although it does counsel caution. 

I offer this definition and elatK)ration of critical thinking as a reason- 
able interpretation of higher order thinking. It is specific enough to pro- 
vide guidance for the development and appraisal of assessment proce- 
dures, including tests. Furthermore, it includes many important qualities 
of people who think well. 
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My comments henceforth shall assume this interpretation of higher 
order thinking, but Uiey axe also apfdicable to most interpretations that I 
have seen* In order to maintain the gi^erality of my comments for those 
who do not accept my proposed interpretation, I shall continue to refer to 
higher order thinking, rather than critical thinking, as the quality or set 
of qualities being asses;^. In my listing of published tests, however, I 
shall tise critical thinking as the ba^sis for selection^ because specific deci- 
sions must be madr. 

The Difficmlty of Asse^ing Hi^er Order Thinking 

Lack of agreement about the intoi^retation of hi^er order thinking (when 
it exists) does increase the difficulty of assessing it We need agr^ment on 
an interpretation to be able to oommtmicate with each oth^. 

But other difficulties fr^juently appear, regardless of the operating con- 
ception of higher order thinking. The problems are most severe in multi- 
ple-choice testing. They give us good reason to be reluctant to use multi- 
ple-choice testing exclusively in assessing higher order thinking. 

Communication 

A basic problem is the difficulty in communicating with students whose 
vocabularies are limited. In the Connecticut Cartoon Critical Thinking 
Test (presented through a combination of cartoons and reading) my co- 
authors and I asked fourth graders to identify the conclusion of a very 
short argument, such as, *We can*t clean the park, because there is only 
one trash can."* The conclusi'^n is, "We can't clean the park.'' But some 
students do not know this meaning of the word "concJ'ision.** 

To them, "conclusion'' means the ending or closing oS of something, not 
what a speaker or writer is trying to establish or justify. So they do not 
understand the question. We had similar difficulties asking them to iden- 
tify assumptions. Dealing with these misinterpretations requires time 
and often individual attention, both of which ar^ scarce -resources. 

Ideology 

Another problem is the temptation to impose the ideology of the test 
author^ as in the following Watson-Glaser test item that asks whethi^r A 
is a strong argument for J5, or a weak argument for B: 
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A. Labor iimonsha\^caUedstnkes in a number (^im 

B. A stroag labOT party would not promote 1±iie ^ 
pie of the United States. 

A is keyed *^eak argument in a(x»rd with the 1930s liberal ideology 
of its authors. Even thoi^ I agree A is a weak rea^m^ keying it as weak 
seems un&tr to some political amserv^sdires with a different ideok^. 

Aca)rdii^ to at least some ranservativeSy strikes in important indus- 
tries do TOvere damage to the economy, and would ptxA>si>ly be fostered by 
a strong labor party. Qiven this ideol<^cal stance, A is a strong argument 
for B; but a student who mark^ it would be scored wrong. The solution 
to this second problem is to avoid mxiltiple-choice questions that call for 
the application of one's ideology. 

Dispositions 

A third problem is the apparent difficulty of assessing higher onier think- 
ing dispositions with multiple-choice tests. A disposition is a tendency to 
do something. Two examples of higher order thinking dispositions are the 
tendency to look at things firom others' points of view, and the tendency to 
seek alternatives. 

I have never seen a multiple-choice test that effectively tested for a 
higher order thinking disposition. Solving problems probably requires 
using alternatives to multiple-choice tests. Possible alternatives include 
essay and performance testing, interviews, and naturalistic observation. 

Background Beliefs 

A foiirth problem lies in possible dififerences between the background fac- 
tual beliefs of the test taker and tfte test author. In the Cornell Critical 
Thinking Test^ Level X, for example, an item asks students to choose 
whether a health officer or a soldier is a more reliable source of informa- 
tion about the water supply on a newly discovered planet. It is a factual 
matter whether health officers or soldiers are generally better informed 
about such thing*:. The test key assimaes that health officers have more 
expertise, and thuK are more credible. 

But imagine someone who beheves that soldiers generally are better 
informed about such matters — or that soldiers on such expeditions would 
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be better informed. That f^iwn would probably get the item wrong, even 
though he or she employ^ the principle for whidi the it^kn was testing — 
that expertise and experience tend to make a person more credible as a 
source of information. 

There are several ways of dealing with this background telief problem- 
One is to interview students to find out their reasons for answering the 
way they did, to make sure that the test key is not prejudi<^ against 
them, and to use the test only with students of the same background bias. 

This approach is recsommended by Norris and us^ by him and King in 
the validation of their Test on Appraising Observations. The approach 
seems valuable, but not easy to implement, and does not guarantee that 
the problem will not arise, even among supposedly similar students. 

A second way of dealing with this problem is to make the test specific 
to some school subj( ct matter area and to assume that students with 
background beliefs contrary to those of the author are mistaken and 
should get the item wrong. 

This approach has some value, but it presents at least three problems: 
it penalizes good thinkers who are misinformed; it assumes that alleged 
subject matter facts are estabUshed and not subject to change; and it will 
not work for tests that assess whether students cap- apply their thinking 
abilities and dispositions in new areas, or those of everyday life. 

Thus, for example, it will not work for tests th^t attempt to assess 
whether the thinking taught in school transfers to everyday life. 

Asking students to justify their multiple-choice answers, perhaps limit- 
ing them to one sentence per item, is a third way to deal with the prob- 
lem. This requested sentence would probably reveal differences in back- 
ground beliefs for which students should not be penalized, but would 
require that the test administration include the reading and judging of 
these sentences. This must be done by flexible people well versed in criti- 
cal thinking and the topic matter of the item- More about this later. 

A foiulh way of mitigating backgroimd behef is to employ essay test- 
ing in which students are asked to defend their answers, proposals, or 
other conclusions- Such essay testing deals fairly effectively with the 
background belief problem, because students usually reveal their 
assumed background beliefs in giving their reasons, and graders can 
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take these beliefs into ac^unt Standardization of sa>ring, and compari- 
son of individuals and groups are possible with essay testing, but this 
sort of ass^sment is generally more expensive than multiple-choice test- 
ing, unless the group is smalL 

Other ways of dealing with the background belief problem include 
interviews, performan^, portfoUos, and naturalistic observation- Unfor- 
tunately, these are eiq^nsive and time-consuming. B^»use of standard- 
ization problems, they are also less amenable to accountability assess- 
ment. For some people, this is a strong argument against accountability 
asi>essment. 

I have used all the above methods and find them to be of some merit. 
Locating an TCirigring Published Test 

It is convenient to divide published higher order thinking tests into two 
groups, those that are exphdtly presented as higher order thinking tests, 
and those that incorporate higher order thinking in tests with other stat- 
ed purposes- 

Explicit Higher Order Thinking Tests 

Unfortunately, not many published tests have higher order thinking as 
their explicit and principal concern. Most are multiple-choice tests. The 
tests that do exist might possibly be part of an overall accountability 
battery. None are revised regularly, however, so security could become 
a problem, especially for the multiple-choice tests. (Perhaps they could 
be used as models by people developing their own tests.) 

The ones known to me are listed alphabetically within categories in 
Table 1. None are usable in the primary grades. Some are advertised as 
usable in upper elementary grades, but they must be used with care. 
Users should be duly suspicious of the resiilts. Perhaps as higher order 
thinking is more widely taught, and more attention is given to develop- 
ment of instruments for less sophisticated students, these limitations will 
be extenuated. 
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Table 1 . Some Published Higher Order Thinldng Tests 

Tests Covering More Than One Aspeci of Higher Orcter Thinking 

■ Vw Califorrm CnOcal Thinkk^ SkUb Tb^: CollegB Lbv&I (1990). t>y Peter 
Faclone. The California Academic Press, 217 LaCmz Ave., Mlllbrao, 
Calif. 94030. 

Aimed at colle^ students, but probably usable with advanced and gifted 
high school students, incorporates Interpretation, argument anatysis and 
appraise, deduction* mind bender puzzles* and induction (including rudimen- 
tary statistical inference). 

■ Cornell Critical Thinking Test, Level X (1985). by Robert H. Ennis and 
Jason Millman. Midwest Publications, P.O. Box 448, Pacific Grove, Calif. 
93950. 

Aimed at grades 4-14. Sections on induction, credibility, observation, 
deduction, and assumption identification. 

■ Cornell Critical Thinldng Test Level Z (1985), by Robert H. Ennis and 
Jason Millman. Midwest Publications, Pacific Grove, Calif. 93950. 

Aimed at advanced or gifted high school students, college students, and 
adults. Sections on induction, credibility, prediction and experimental plan- 
ning, fallacies (especially equivocation), deduction, definition, and assump- 
tion identification. 

■ The EnniS'Weir Critical Thinking Essay Test (1985), by Robert H. Ennis 
and Eric Weir, Midwest Publications, P.O. Box 448, Pacific Grove, Calif. 
93950. 

Aimed at grades seven-college. Also intended to be used as a teaching 
model. Incorporates getting the point, seeing the reasons and assumptions, 
stating one's point, offering good reasons, s«b ng other pc^bilities (including 
other possible explanations), and responding to and avoiding equivocation, 
in-elevance, circularity, reversal, and an if-then (or other conditional) relation- 
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ship, overgeneralization, credibility problems, and the use of emotive lan- 
guage to li^rsuade. 

■ Judgment: Deductive Logic and Assumption Recognition {197^)/o)/ 
Edith Shaffer and Joann Steiger. Instructional Objectives Exchange, P.O. 
Box 240%, Los Angeles, Calif. 90024. 

Aimed at grades 7-12. Develc^)ed as a criterion-referenced te^, but with- 
out specific siandards, Irwludes swtlons on dediKnion, assumptiOT identifica- 
tion, and credibility, and distinguishes between emotionalty loaded content 
and other content 

■ New Jersey Test of Reasoning Skills (1983), by Virginia Shipman. Insti- 
tute for the AdvafX^nwTt d Philc^phy for Children, Test Division, Mont- 
ciair State CcMlege, Upper Montciair, NJ. (^043. 

Aimed at grades 4-coltege. incorpofat^ the syllogism (heavily represent- 
ed), assumption identifk^ation, indLK:tion, good reasons, and kind and degree. 

■ Ross Test of Higher Cognitive Processes (1 976), by John D, Ross and 
Catherine M. Ross. Academic Therapy Publications, 20 Commercial 
Blvd., Novate, Calif. 94947. 

Aimed at grades 4-^. Sections on verbal analogies, deduction, assump- 
tion identification, word relationships, sentence sequencing, interpreting 
answers to questions, information sufficiency and relevance in mathematics 
problems, and analysis of attributes of complex stick figures. 

■ Test of Enquiry S/c///s (1 979), by Barry J. Fraser. Australir^ Council for 
Educattonal Research Limited, Frederick Street, Hawthorn, Vtetoria 3122, 
Australia. 

Aimed at Australian grades 7-10 (possibly not the appropriate grade lev- 
els in North America). Sections on using reference materials (library usage, 
index, and table of contents); Interpreting and proces^ng informatjon (scales, 
averages, percentages, proportions, charts and tables, and graphs); and 
(subject-specific) thinking in science (comprehension of science reading, 
design of experiment, conclusions, and generaiizatk)ns). 



82 

88 



Assessing for A c c ountability 

i 



■ Test of Inhrer^ Ability in Reading Ckmipreiiension (1087), by Linda M, 
Phillips and Cynthia Patterson. Memorial University, St. John's, New- 
foundland, Canada A1B 3X8. 

Aimed at grades 6-^. Tests for at^illty to infer infonnation and interpreta- 
tions from short passage. l\4ui^le-choice version (by tK>th autfrors) and con- 
stnK:ted rBsp<mse version (by Philip only). 

■ Watson-Glaser Critical Thinldng Appmisai (1980), by Goodwin Wateon 
and Edward Maynard QIaser. The Psychological Corporation, 555 Aca- 
demic Court, San Antonio, Tex, 78204. 

Aim^ at grade 9~-adutthocxi. Sec^c^ on induction, assumption identifica- 
tion, deduction, judging ^ftrtTether a conclusioti follov^ beyond a reasonable 
doubt, and argument evaluation; 

Teste Coveting Only One Aspect of Higher Order Thinldng 

■ Cornell Class Reasoning Test (1964), by Robert H. Ennis, William L. 
Gardiner. Richard Morrow, Dieter Paulus, and Lucille RingeL Illinois Crit- 
ical Thinking Project, University of Illinois, 1310 S. 6th St., Champaign, 
tIL 618200. 

Aimed at grades 4-14. Tests for various forms of (deductive) class rea- 
soning. 

■ Logical Rehisoning (1955), by Alfred Hertzka and J. P. Guilford. Sheridan 
Psychological Services, Inc.. P.O. Box 6101 , Orange, Calif, 92667. 

Aimed at high ^hool and college students and other adults. Tests for facil- 
ity with Class reasoning. 

■ Test on Appraising Observations (1983), by Stephen P. Nom's and Ruth 
King. Institute for Educational Research and Development, Memorial 
University, St. John's, Newfoundland, Canada A1B 3X8. 

Aimed at grades 7-14. Tests for ability to judge the credibility of obser- 
vation statements- Multiple-choice and constnjcted response versions. 
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Since I am a oo-a\ithor of some of these testa, my conflict in presenting 
this listing is obvious. I have tried not to let it interfere vnth my olgectivi- 
ty, but do ijrge you to read Arter and Salmon's As^ssing Higher Order 
Thinking SkUU: A Consumer's Guide, which provides more extensive cov- 
erage. I also strongly uige you to take and score yourself on any test that 
you serioxisly consider employing. 

Since statistical information about tests can be misleading, it is impor- 
tant to make one's own informal juc^ment about the validity of the con- 
tent. Do not depend solely on the name given to the test by the author 
and publisher. Be sure to consider the followir^ questions: 

■ Is the test bas^ on a defensible conception of higher order thinking? 

■ How comprehensive is its coverage of this conception? 

■ Does it seem to do a good job at the level of your students? 
Although these questions seem obvious, they are often neglected. 

Tests Incorporating Higher Order Thinking 

A niimber of tests that are widely used for "gateway* purposes include 
significant amounts of h^er order thinking. These include the ACT and 
P^ACT, the LSAT (Law School Admissions Test), the forthcoming MCAT 
(Medical Collie Admissions Test)^ the general (non-subject-spedfic) GKE 
(Graduate Record Examination), the Iowa Test of Educational Develop- 
ment, and the College Board's AP (subject-specific Advanced Placement) 
tests. Of the two most-widely-used gateway tests^ the recently-revised 
ACT incorporates more higher order thinking than the SA \ according to 
a recent study done at the University of Illinois, Perhaps the forthcoming 
new SAT will turn the tables. 

To my knowl^ige, most existing heavily-used accoimtabiUty tests have 
not been carefully studied for their incorporation of higher order thinking. 
Cursory inspection of many of them suggests Uttle incorporation. Excep- 
tions are the ACT and the Iowa Test of Educational Development, which 
do incorporate significant amounts of higher order thinking, and are 
sometimes used for a<xountability purposes in hi^ schools. 

Most of the gateway tests are used with upper-level students, under- 
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scoring the great need for development of standardized, lower-level 
assessments that inrarporate hi^er order thinking. The existing gate- 
way tests do provide models for the development of broad lower-level 
tests that assess hi^ier order thinking. 

The need is there. If it is expressed in the right places — large school 
districts, state and federal education departments^ foundations, and 
large-scale testing a>rpOTations might respond with an array of lower-lev- 
el tests, not exclusively devoted to higher order thinking, that incorporate 
it I might add that a similar need exists for more tests that have higher 
order thinking as their primary concern (specially lower-level tests). 

Developing Your Own Tests or Ass^^ment PrcK^ures 

If published tests do not meet your ne^is (and for many people they will 
not), then developing ytnxr own tests or other assessment procedures is 
worth considering. Steve Norris* and my publication, Evaiuating Critical 
Thinking (1989), is the basis for the sugg^ons that follow. Developing 
high-quality multiple-choice tests of hi^er order thinking is probably not 
feasible for most separate schools and small to mediimi size school 
districts. The low volume of u^ would make each test quite expensive to 
develop. And costs are high for good tests. 

So I shall not focus on the development of high-quality, high-volume 
multiple-choice-only tests. Instead, I shall discuss three alternatives to 
such testing: one-sentence defenses of multiple-choice items, essay tests 
with varying amounts of structure, and performance tests of various 
sorts. These alternatives can be developed by separate schools and small 
to medium sized school districts. They can also be used by large organiza- 
tions that are unwilling to ao^pt the disadvantages of multiple-choice 
testing. 

One^ntenee Justifications of Answers to 
Multiples-Choice Items 

One way to counteract the diflSculti^ of multiple-choice tests is to ask for 
a one sentence defense of a student's answer to each multiple-choice item. 
This approach necessitates fewer items, given the same amount of testing 
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time, and som«me must read the student's defense. This reader must be 
flexible and well-versed in the topic and in hi^er order thinking . He or 
she must be able to figure out the student's bac^round l^Uefs, and to 
rea^:nize good blinking, evr - when the studentf s actual thinki;^ was not 
what the test writCT k t in x^nd 

The multiple-choice items that form the basis of such assessment must 
validly test the gnals to be assessed, and must constructed with consid- 
erable care. They need not be tried out extensively, however, and refined 
again and again as is done by professional test publishers. The student*s 
defense of his or her answers provides a safety valve for misinterpreta- 
tion, insufficiently refined items, and differences in background belief 
assumptions. 

It is even possible that higher order thinking dispositions may be 
exposed in this one sentence defense strategy, but I have not yet seen a 
strategy that can ensure this. 

Essay Testing 

Essay testing, in which students are asked to formulate and defend a 
position, is a good general way to assess higher order t hink i ng . But how 
does one do that effectively, and evaluate the results in a reliable man- 
ner? I can suggest three often-overlapping methods. 
1. Providing considenible structure. One way is to provide a reading pas- 
sage with certain built-in problems and strengths, to ask students to 
appraise all or selected parts, and to ask them to defend their appraisals. 

The EnniS'Weir Critical Thinking Esmy Test exemplifies this approach, 
and can serve as a model for development of similar tests. It presents stu- 
dents with a letter to an editor of a newspaper that offers and defends a 
proposal to prohibit local overnight street parking. The letter is in the 
form of separate nimibered paragraphs, most of which contain faulty rea- 
soning (given the test authors' backgroimd beliefs and assimiptions). Stu- 
dents are asked to appraise the thinking in each paragraph, in the letter 
as a whole, and to justify their appraisals. 

Given such extensive structuring, it is possible to develop a scoring 
procedure that is fairly specific. (It also must be fiexible to account for 
variations in interpretations and backgroimd beliefs.) 

High inter-rater agreement can be achieved; the Ennis-Weir, for exam- 
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pie, has inter-rater correlations ranging from .82 to .92. Skilled graders 
averag"* six minutes per student paper, neglecting breaks. But please 
realize that this grading proc^iire in more time-consuming and exi^n- 
sive than one that uses a high-volume (multiple-choice) test-scoring 
machine. 

Testing organizations, such as the Educational Testing Service (ETS) 
of Princeton, N.J., have developed sophisticated procedures for spring 
large numbers of essays with reasonable reliability. Manual:i for large 
scale essay test grading are available from ETS* 

2. Providing less structure: Reque^ng an interpretation and defend for a 
passage as a whole. One less-stmctixred approach presents a more or less 
complex passage and asks for t.n interpretation and commentary on its 
thesis or theses, acrompanied by a defense The student must identify the 
thesis. 

The passage and the accompanying request provide structure, though 
less struct'^re than provided by the Ennis-Weir, which divides the pas- 
sage into sections and requests a reaction to each section. College Board 
AP tests in English and history often use this less-structuired approach. 

3. Providing on ly a topic and requesting the defense of a thesis about the 
topic. Even less structure is provided when a topic or thesis is provided, 
but no reading passage. The National Assessment of Educational Pn^ess 
(NAEP) has used this approach. 

This is an example: **Take a stand on whether a bike lane should be 
installed and refute the opposing view."* (Note that this particular exam- 
ple provides more structure than just asking students to take and defend 
a position; it tells them that refuting the opposing view is part of the 
assignment.) 

NAEP has had extensive experience with such testing, so its publica- 
tions and staff may be of help to any organization trying to develop its 
own procedures. With the prospective entry of NAEP into state-by*state 
testing, cooperation with individual schools might be a future possibility. 
(NAEP is located at Educational Testing Service.) 

Another example of this approach can be found in the work of th? Illi- 
nois Critical Thinking Essay Contest (ICTEC), directed by Steve Tozer of 
the College of Education at the University of Illinois. In a recent contest, 
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open to all Illinois hi^ school students, the following task was set: 

Bearing in mind that learning takes place outside the dasaromn as well as in, 
and that it can be negative as well as positive, what do you believe is the 
activity or ^tting that most importantly influences learning for you and the 
students you know l»st? Itefi^d yoin- portion. 

Note that the «"jbject matter of this particxilar essay comes from the 
experience of the students, and is not the subject matter of a standard 
course (in contrast to the topics of the College Board's AP tests). The 
ICTEC tasks test for transfer of higher order thinking to topics of every- 
day life, but both school subject topics and general knowledge topics are 
amenable to the approach. 

Performance Testing 

Performance testing for higher order thinking is a relatively unexplored 
area. Performance testing can range from asking students to do set tasks 
(such as plan an experiment) to totalb' open-ended observation with 
anecdotal records. The more open-ended the assessment is, the less 
amenable it is to standardized reporting, and hence the more difficult 
and expensive it is to use it in accoimtability testing. But such open-end- 
ed assessment does have much intuitive appeal. 

The departments of education of California, Illinois, and New York 
are currently investigating standardize performance assessment in sci- 
ence* Their performance assessment procedures do include some higher 
order thinking tasks, but much work remains to be done. 

Subject Specificity of A^essment 

Should higher order thinking assessment be specific to subject matter 
areas» or use topics with which students at the grade level can be expect- 
ed to be familiar (e.g., NAEP's bike lanes, or ICTEC's student learning 
topic)? This questions is related to, but different from the instructional 
question: Should higher order thinking instruction be incorporated in 
existing subject matter instruction, or provided in some general manner, 
or both? The ass^sment question is not settled by answering the instruc- 
tional question. 
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Regaz^dless of the ijostructional approach, I believe that we should have 
and use lK)th subject specific and general content hi^er order thinking 
assessment Ass essi ng a student's ability to think within a £^ooI sufagect 
is needed, ber^use omtent has not beai learned well tmle^ a student can 
think in that subject. Assessing general knowledge content is aL^ neces- 
sary to determine whether higher order thinking im traction has trans- 
ferred to everyday life. 

The Cost of Hifi^er Order Thinking A^e^ment 

Good higher order thinking assessment is expensive in both time and 
money. It takes considerable time to develop good multiple-choice test49> 
and considerable time to appraiw non-multiple-choi^ assessment Since 
higher order thinking assessment is inherently expensive, we must be 
wary of the ec^ cutter who would shortchange the process. 

Another expense is student time. Too much as^ssment leaves insu£5- 
dent time for instruction- A related danger lies in what might otherwise 
be an excellent assessment practice: using teachers to administer and 
appraise authentic performance assessment 

The problem, as in England's new a^essment program, is that most of 
the students have nothing to do while the teacher is engaged in authentic 
assessment of small groups. Possible solutions are to cut back on the 
€unount of assessment or to hire people to help the teachers. Again, good 
higher order thinking assessment is expensive. But can we afiford not to 
do it? 

Summary 

After noting a variety of reasons for our interest in higher order thinking 
assessment, I urged various steps to ensiu^ that such assessment not be 
left out of the current accountability movement Some of the problems asso- 
ciated with higher order thinking assessment were considered, and a num- 
ber of comments and suggestions made for dealing with these problems: 

1. Although higher order thinking is a vague term, critical thinking, 
defined as "reasonable and reflective thinking focused on deciding what 
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to believe or do,*" can serve as a sixitable interpretation when elaborated 
appropriately. 

2. Hi^er order thinking is difficult to assess, the two greatest problems 
being variations in students' bad^round Actual belie&, and the difficulty 
of assessing dispositions, (e.g., openmindedness). These problems are 
manageable, but probably not within the trEKlitional multiple-choice form 
of assessment. 

3. Explicit higher order thinking tests exist for grades four and up, but 
there are too few. Tests must still be developed for students below grade 
four. There are also few t^ts with otJber primary purposes that inwrpo- 
rate higher order thinking assessment In any case, test users must check 
the validity of the test content for the puriK^es at hand. (It is imwise to 
depend solely on the name that the author and publisher have given to 
the test.) 

4. For those developing their own assessment procedures, alternatives 
to standard multiple-choice testing include requesting justification for 
answers, using essay questions with varying degrees of structure, and 
examining actual student performance in some way. 

5. Higher order thinking assessment is needed both within subject-mat- 
ter areas and in the general-knowledge areas of everyday life. 

6. Good higher order thinking assessment is time-consuming and expen- 
sive. 

Suggested Further Reading 

Applebee, Arthur N.; Langer, Judith A.; and Mullis, Ina V.S- Tfie Writing Report 
Card: Writing Achievement in American Schools. Princeton, N.J.: National 
Assessment of Educational Progress of Educational Testing Service, 1986. 

Arter, J., and Salmon, J. Assessing Higher Order Thinking Skills: A Consumer's 
Guide. Portland, Oreg.: Northwest R^onal Educational Laboratory, 1987. 

Educational Testing Service. Guidelines for Developing and Scoring Free Response 
Tests. Princeton, N J.: Educational Testing Service, 1987. 

fcnnis, Robert H. **Critical Thinking and the Curriculum." National Forum 46 
(1985): 28-31, 

. ^'A Taxonomy of Critical Thinking Dispositions and Abilities." In Teach- 



90 



ERIC 



Assessing for A c (^>o u a>.b il i t 




ing Thinking Skills: Theory and Practice, edite^^y Joan Boykoff Baron an* 

Robert J- Sternberg. New York: WJH. Freem^ i£SI7^ ^ 
Norris, Stephen P., and Ennis, Robert H, Evaii^ibiJig Critical Thinking Pate$i^ 

Grove, Calif.: Midwest Publicatdoni?. 1989. S ^''j 
Powers, Bert, ed. Illinois Critiad Thinking ^i^&al: Proceedings of the Univef^m^ 

of Illinois College of Education Critical^ ThirUiing Essay Contest. Chanapaigfi 
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Note: I appreciate the su^estions made in prepfcaring ihisjnaifuscript by Mi^eBb- 
Comnioyras, Helen Ennis, Suzanne Faikus, Linda Mabry, Betty MerchantjiSaS^ ^ 
dra Pearse, Nona Prestine, and Philip Zodhiates. j 
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Teaching Thinkiiig: 
An Integrated Approach 

Barry K Beyer 



During the past decade, a wide variety of teaching methods and 
approaches have been proposed for impro^ang student thinking. 
These range from technique for teaching selects 1 skills, to spedfic ways 
teachers shotild behave, to general curriculum approaches reminiscent of 
the discovery teaching of the l^Oo. In spite of—perhaps because of-— the 
great diversity of these approaches, educators have too often treated 
them as competing or mutually exclusive and have directed their efforts 
at finding the one best approach to implement. But, the truth is, most of 
these techniques and approaches are not mutually exclusive. In fact, no 
single approach can, by it^lf, do what is necessary to improve student 
thinking to the extent deemed necessary or desirable by experts and 
observers alike. 

Educators who truly wish to improve student thinking can and should 
combine a number of these approaches. When several are integrated and 
used throughout a school's curriculum, the resxdting program can have a 
powerful impact. Indeed, the total program impact can be even greater 
than the results of each of the individual approaches. 

Which approiiches and/or methods can be combined to produce an 
effective thinking program? At least five should be considered: 

1. Establishing and maintainii^ a thoughtful learning environment 

2. Providing instruction in the skills deemed essential to good thinking 

3. Using the techniques and strategies of direct instruction in teaching 
these thinking skills 
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4. Modeling by teachers of the thinking behaviors that are supportive of 
gotxl thinking 

5. Integrating these four approaches throughout the curriculum, in all 
m^jor subjects. 

Schools can bring about significant and positive improvements in stu- 
dent thinking by combining these five elements into a cohesive instruc- 
tional program. This chapter explores the nature of these five elements 
and their interrelationships. By becoming familiar with these elements 
and their potential for improving thinking, principals, other administra- 
tors, and supervisors can tetter assist teachers in developing, implement- 
ing, and sustaining an instructional program that can significantly 
improve student thinking and academic achievement. 

EstabiishiBg a Thoughtful Leamiug Environment 

A thoughtful learning environment is one that promotes and supports 
higher order student thinking. Such an environment provides an oppor- 
tunity to thinkf support in thinking, and engagement in thinking. 

By meeting these conditions, educators can create a climate that nur- 
tures thinking beyond the level of recall and translation, as well as a con- 
text or environment in which more complex thinking can occur. Such con- 
ditions, in effect, provide the "rich surround"" that researcher David 
Perkins, for one, claims is essential to developing thinking. 

At least four elements combine to constitute a thoughtful learning 
environment: 

1. A classroom layout that invites thinking. Traditional theater-style 
seating, where students are arranged in rows, all facing forward, encoiu'- 
ages listening, lecturing, and recitation, the hallmarks of receptive learn- 
ing. Seating students fadng each other in groui>s or clusters, or around a 
hollow square, not only makes possible but encourages the kind of stu- 
dent-to-student interchanges that stimulate good thinking. 

Such a classroom layout is enhanced by means of wall posters and 
signs presenting helpful hints, suggestions, and ideas related to think- 
ing, as well as generalizations, hypotheses, and the other products of 
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thinking. The resulting classroom arrangement provides opportunities 
for and invites active student leamii^ and thinking, 

2. Classroom interactions that involve infomation processing, rather 
than information receiving and repeating. These interactions involve 
students in posing problems and inventing hypotheses; in comparing, 
analyzing, and judging the worth of arguments, the accuracy of 
hypotheses, the adequacy and accuracy of evidence, and the quality of 
reasons offered in support of claims; and in asking and answering ques- 
tions. 

Students interact with each other as much or more than with a teacher 
as they continuously seek to locate and verify information, identify other 
points of view, search for hidd^ assimiptions, and determine a wide vari- 
ety of alternatives and possible explanations. In a thinking classroom, 
students dissect, reflect on, and add to what they read, hear, see, or feel 
to give it new meanii^, rather than simply tryiog to remember the mean- 
ings ascribed by textbook authors or other sources. 

3. The use of precise, thoughtful language rather than vague terminol(^ 
or generalizations. Researchers David Olson and Janet Astington, as well 
as educator Arthur Costa, have stressed the importance of language in 
supporting and fadUtating thinking. Rather than using the word "think** 
to signify virtually any and all cognitive operations, teachers and stu- 
dents should use more precise terms that accurately signify the mental 
states or actions to which they are referring. 

Instead of saying, "Tell me what would happen next,** a teacher or stu- 
dent should say, "Predict what would happen next.*" Instead of asking, 
"What do these data tell you?** one would hear, *What conclusions can be 
drawn from these data?** 

Thinking terms, such as hypothesis, argument, evidence, inference, 
and assumption, for example, not only cue appropriate thinking behavior 
but also help students differentiate — and store for future use — the essen- 
tial cognitive operations that constitute thinking and learning. 

4. The organization of classroom study and courses around thoughtful 
questions. Researchers Fred Newmann, Francis Schrag {whose views on 
thoughtfulness are presented earlier in this book), and Grant Wiggins 
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assert the importaiKe of chaUengixig students to tliink if we expect them 
to develop their thinking at alL This means engaging them in thou^^tful 
inquixy. 

Such inquixy can be built around questions of fundamental interest to 
the students and essential to the discipline or subject being studied^ ques- 
tions that also bring students into omtact with perepe^ves other than 
their own, and qu^tions to which there are no sin^e onrrect answers or 
for which there is no sin^e correct way of finding answers. 

For example, a question such as, To what extent did people in the 
United States cope during the Civil War with interruptions in their per- 
sonal agendas as we do today?" might well serve to organize a thoughtful 
analysis of, and learning about, this m£gor period in American history. 
Structuring student learning around questions like this allows for sus- 
tained and in-depth examination of a limited nutmber of topics, continuing 
involvement in the sul^tance of a subject or disdpline, and active mental 
engagement with subject matter — all of which are required for the devel- 
opment of higher order thinking. 

If secondary xhool students are to improve their thinking, they need a 
learning environment that allows them to use the kinds of thinking they 
need to develop, that nurtures and supports such thinking, and that 
invites them to think. 

By attending to these four aspects, principals and teachers can create 
and maintain such an environment. 

Teaching Thinking Skills 

Thinking is a skillful (read: skxLhfull) enterprise. Any act of sustained 
thinking consists of a variety of discrete cognitive operations, or skills, 
used in various combinations to produce an intended result or product. 
Thoughtful inquiry, for example, requires, among other things, analyzing 
data to identify or define a problem; synthesizing hypotheses; recalling or 
synthesizing plans for testing these hypoth^es; recalling and/or locating 
sources of data; evaluating the relevance, accuracy, and suflBdemy of the 
data found; and drawing conclusions about the validity of the hypotheses 
being tested The extent to which individuals are skilled at carrying out 
each of these or similar operations shapes the quality of the thinking in 
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which they engage and of the products that r^ult 

Thinking skills are, in effect, the tools of thinking. Proficiency in the 
use of these tools is esi^ntial to good thinking. It has been said that if the 
only tool we are good at using is a hammer, then we are likely to treat 
every problem as a nail; to resolve it, we just beat on it. But if we are 
skilled at using a variety of tools, we can select and use thc^ that are 
appropriate to the types of problems that we encounter, and thus have a 
better chance of resolving each in the most productive way pebble. 

Developing proficiency in a nimiber of key thinking skills enables stu- 
dents to cope successfiilly with a wide variety of thinkir^g challenges. And 
improved thinking results in significant gains in academic achievement 
as well as in the quality of one's life. 

Unfortunately, most secondary school students are not very proficient 
in the skiUs of good thinking. Most of them cannot solve problems, make 
decisions, or conceptualize very well. Nor are they very skilled at or even 
inclined to engage in critical thinking, especially in the more diffioilt crit- 
ical thinking skills such as detecting bias, identifying point of view, iden- 
tifying imstat^ asstmipti(ms, or determining the logic of an argument. 

Proficiency in these operations is not a result of simply growing older, 
as experts David Perkins, Robert Sternberg, Arthur Whimbey, Edward 
deBono, and Benjamin Bloom, among others, have repeatedly pointed 
out. Nor, as educator Hilda Taba and ethers showed years ago, does good 
th i nking develop as an incidental result of instruction that focuses exclu- 
sively on academic subject matter. 

If students are to improve their thiriking, school and classroom curricu- 
la must treat selected thinking skills as subjects of instruction as impor- 
tant as the course content they have traditionaUy sought to teach. 

Explicit attention must be given to developing student expertise in 
problem solving, decision making, conceptualizing, and argument making 
and analysis, as well as to the m^yor operations and dispositions of criti- 
cal t h i n ki n g and to sig^oificant information prcK^essing skills like inductive 
and deductive reasoning, analysis, synthesis, and evaluation- 

Any secondary school curriculum, to be worthwhile, should include 
mastery of these skills as essential outcomes of instruction. Students 
must be helped, by instruction in these skills, to take advantage of the 
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opportunities to think provided by a thoughtful learning environment 
and to achieve more effectively the subject matter learnings that serve 
as the goals of education. 

Using the iy»chniqa^ and Strat^es of Direct Instruction 

It takes more than practice or exercise to become proficient in thinking. \ 
thoughtful le44ming environment and concern about specific thinking 
skills can prove relatively ineffective in improvii^ student Uiinking if stu- 
dents are unable to execute the cc^nitive operations needed to engage in 
the thinking require of them. Teachers must provide explicit instruction 
in how to carry out ^e oi^rations or skills students lack or iii which they 
are less proficient than they should be. This means that schools and 
teachers should provide direct instruction in these skills. A number of 
techniques and strategies are well suited to this piupose. 

Skill Teaching Techniques 

Claseroom research recently summarized by Barak Rosenshine and Saul 
Chapman has demonstrated the value of specific techniques for providing 
such instruction. Unlike many of the techniques commonly used to 
teach" thinking in classrooms (i e,, filling out exercise sheets, asking 
questions of different levels of difficulty, holding discussions and debates, 
and even exhorting students to, *^ow, think!""), these techniques and 
strategies do more than simply make students think 

They provide, in varying degrees of explidtness, actual instruction in 
the rules and promiures hy which specific thinking operations can be car- 
ried out. Continuing use of these techniques across the curriculum is 
essential at those points where skills are needed by students to engage 
successfiiUy in a thought learning experience. 

Among the most powerfiil techniques for providing this instruction are 
the following, listed in order fi^m the most to the least explicit focus on 
skill proc^iures and rules: 

1. Modeling 5. Use of graphic organizers 

2. Metaa)gnitive reflection 6- Cuing 

3. Use of procedural checklists 7. Labeling, 

4. Rehearsal 
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Teachers can use all these techniques to provide instruction on how to 
perform any thinking skill, in any sutgect matter, with any student Some 
of these techniques involve more than is customaxily practiced by most 
teachers. Space does not permit a thorough explication of each here, but 
some important paints should be hij^ili^ted, 

1. Modeling consists of more than simply carrjdng out a skill operation 
step-by-step as students watch. It also involves explaining exactly what 
options are available at each step, and why each specific option is select- 
ed- Explanation and execution are part of modeling; one without the other 
is insufl5cient 

2. Metacognitive reflection engages students in thinking about their own 
thinking. Helping students reflect on how they execute a specific thinking 
opetation raises their thinking to a level of conscioxisness that allows 
them and their teachers to diagnose any procedural problems and enables 
students to access that operation on demand in the future. It is one way 
of helping student thinking to be«)me more intentional. 

Teachers can guide student metaa)gnitive r^ection by asking them, in 
essence, *What did you do in your mind to complete this task? What did 
you do first? Why? Next? Why? Next? Why?" and so on. Student responses 
to the "whats" will be procedures used; to the **whys,*' niles or heuristics. 

In guiding this activity, teacher? have students reflect on how they did 
a thinking task; put what they believe they did into words, either orally 
or in writing; share their explanations or descriptions of their thinking 
with others who have engaged in the same task; and listen to others 
report how they did it. 

Repeated metacognitive reflection and analysis help students imcover 
gaps or errors in their thinking, and acquaint them with difierent proce- 
dures used by others, 

3. Procedural checklists assist students in completing a thinking task by 
allowing them to check off each step or rule or criterion as it is used dur- 
ing the procediire, 

4. Rehearsing a procedure or various procedures for thinking before actu- 
ally doing it helps students recall what they need to do in carrying out a 
task, and how to structure their execution of the task. 
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5, Graphic organizers require a s{^al note. These visuals are graphs, 
diagrams, or charts structure to Valk" students through the key steps 
of a thinking ^ill, and require them to apply the mcgor rules or criteria of 
that specific skiB or a>mbination of skills. 

Not every chart or di£^;ram is a process oz^anizer. Webs, for example, 
structure the products of thinking but do not structure the thinking pro- 
cesses by which these products are developed. 

Teachers can use oi^anizers such as those in Figure 1 to assist stu- 
dents in (^nying out tasks requiring selected thinking skills. These orga- 
nizers, in effect, guide students in doing the skill, and serve as process 
scaffolds in constructing meaning. 

6. Cuing consists of using the name or label of a thinking skill in the 
directions that require its use. Instead of saying, "What do you think 
caused the water to rise in this experiment^ a teacher can say, "What is 
your hypothesis about why the water rose ttiis time?" Use of skill names 
helps students recall what they need to do to answer skill-using ques- 
tions. 

Z Labeling is similar to cuing, but occurs after a thinking act has been 
completed. For example, when a student has reported "It is probably 
going to rain tomorrow,** the teacher might respond, "That's an interest- 
ing prediction." Labeling what students do with the name of the skill 
helps them store in memory what they did for easier retrieval and to use 
it when the skill is cued in later dass activity. 

Some of these techniques (modeling, rehearsal, cuing) can immediately 
precede student use of a thinking skiH; others (checklists or graphic orga- 
nizers) can accompany use of the skill; still others can follow skill use 
(labeling, metacognitive reflection). All provide the kind of feedback or 
"feedforward'' that actually shows how to carry out the skill, albeit some 
much more explicitly than others. Each of these techniques, even when 
used alone, is usefiil, because it focuses on the procedtiral attributes of a 
skilL When used in combination, the instructive power of these tech- 
niques is enhanced considerably. 

Skill Teaching Strategies 

Students benefit fix)m different kinds of instruction, depending on where 
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Figure 1 . Graphic Organizers for Selected Thinking Skills 
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they are in their learning of a glrilV Cognitive r^earcb indicates that stU'- 
dents encountering a particular skill for the first time need to focus on 
the skill pnx^ure, not the content to which the skill is being applied 

They must see the skill modeled, and they benefit immensely from 
reflecting on a^id articulating how they performed the skill when they 
had an opportunity to apply it. In practicing a skill to which they have 
already been introduced, students benefit fi:om reviewing how they did it 
earher, and from using a graphic organizer or a checklist to assist them 
in carrying it out 

Research on skill acquisition and cognition indicates that, for best 
results in skill learning, teachers should provide the following kinds of 
lessons for each thinking skill they wish students to master 

■ A lesson introducing the skill 

■ A number of guided practice lessons 

■ Several lessons that caU for the skill upon teacher cue 

■ A lesson initiating tranter of the skill to a new setting 

■ Several guided practice lessons using the skill in these new settings 

■ Repeated opportunities for students to use the skill on their own and 
in combination with other skills. 

The techniques described in the above section can be used in diflFerent 
combinations to structure the various lessons. One strategy for a 25-45 
minute lesson introducing a new thinking skill goes as foUows: 

■ The teacher TOxfeZs the skill 

■ The students apply the skill 

■ The students reflect on how they carry out the skill (metacognitive 
reflection) 

■ This sequence is repeal several times. 

A strategy for guiding practice in a skill after it has been introduced 
might consist of combining the following four techniques in this order. 
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The teacher cues the skill 
Students rehears how to do it 




■ Students apply the skill nsmg a ch^klil^^r graphic o: 

■ Students reflect on how they carried out tfil skill witB'?he\eacher 
modeling any difficult parts, as necessary. *t 

By hooking different techniques together in var|ous combina 
teachers can magnify their instructional power and j^rovide inval 
insight to students in carrying out any thinking skilly These techniq^ 
and strategies may be planned, or used on the spur oSthe inpment w 
a teacher realizes that students need help in thinking, ^^fany^ther stra 
gies can be created by combining these techniques witlM)ii^ples of 
teaching to provide varying d^ees of direct instructi» to* any th 




skill 




Tteacher Modeling of Skillful Thinkiiig ^ J 

There is more to thinking than mastery of discrete cogidltive skills, hetefir- 
tics, rules, and other procedural knqWledge. Dispositions are eqi^ly 
important. These include a willingness to engage in thinking tasks, 
thinking skills in appropriate wmbinations, to suspend judgment, togii^ 
and seek reasons and evidence in support of a claim, to explore other* 
points of view, and so on- 
Good thinkei^ habitually behave in ways that illustrate and are driven 
by these dispositions. Improving student thinking requires serious efforts 
to develop these dispositions while simultaneously teaching the skills^ 
needed to act on them with purpose and success. 

One way for teachers to nelp students develop the dispositions of i 
thinking is to model the v^y behaviors students should exhibit as 
thinkers, Arthur Costa Jias described a number of techniques teachi 
can use to lead, and sometimes force, students to exhibit these beh^ 




* See, for example, Barry K. Beyer, Practical Strategies for the Teaching of T7i\ 
ing (Boston: Allyn and Bacon, 1987). 
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iors — techniques such as wait time, playii^ devil's advocate, and so on. 
Teachers also must do what they strive to get students to do. 

Teachers, for example, should wait in n^ponding to student qu^tions. 
Instead of giving instant responses, they should remain silent and ponder 
a bit before responding; they should reflect aloud on how they are pro- 
cessing data as they frame responses; they should tell the students why a 
question they have asked is worth asking and answering; they should 
thiik aloud as they plan avenues of inquiry; they should encourage stu- 
dents to pcxaphrase the teacher's reflections and to challenge them; and 
they should deliberately present and consider information or issues from 
different perspectives. 

Teachers shoiJd tell students what they are doing and why. These are 
the ways good thinkers behave, and everyone in the class— including the 
teacher— should exhibit these behaviors habitually. 

Teaching dispositions, of couurse, involves more than modeling. Requir- 
ing students to exhibit behaviors that reflect given dispositions is also a 
useful way to accomplish this goal But modeling is basic, especially if 
teachers hope to persuade students to alter attitudes and dispositions 
about thinking formed before they entered the middle and upper grades. 

Teaching Thinking Across the Curriculum 

Most experts agree that thinking should be taught throughout the school 
curriculum. Researcher Lauren Resnick and her colleagues argue that 
certain kinds of thinking may work diflferently in different disciplines. 

Other researchers, including David Perkins and Gavriel Salomon, 
assert that thinking operations do not transfer easily from one subject or 
context to another, nor are students inclined to make such transfer 
unaided. Teaching thinking in a wide variety of subjects assists students 
in making the transfer needed to generalize their thinking. 

Thinking and subject matter are, in fact, inextricably interwoven. 
Subject matter serves as a vehicle for thinking, and for learning to 
think better. Thinking and thinking skills are tools for learaing subject 
matter und making meaning out of it. Incorporating the approaches to 
the teaching of thinking presented here in all or virtually all subjects of 
a school curriculum will enable students to reap the benefits of better 
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academic achievement and develop the ability and willingness to think 
more effectively. 

Conclusion 

No school is likelv to make much lasting improvement in student thinking 
without incorporating the five appnoaciies or dements described here into 
a wmprehensive thinking program. Providing an environment in which 
thi n k i ng is p<^ble is, by itself, not likely to benefit all students. Teaching 
specific skills without providing meaningful opportunities to use them or 
developing the disposition to use them well will produce less than satisfac- 
tory results. 

Actual instruction in how to carry out th^ essential thinking skills is 
imperative for students unable to execute them. Teachers who fail to 
model skillfiil thinking will undermine the intended effects of both a 
thoughtful environment and direct instruction in thinking skills. And, 
unless all these elements are utilized in viirious subject matter courses 
dining the school years, students will not learn how to think well or use 
their tliinking skills to learn the academic subjects required of them. 

By combining these five approaches to teaching thinking, however, 
educators can maximize their individual effects and produce a program 
with the potential to make a significant difference in student thinking, 
school achievement and, in the long run, our dvic life as well. 

Although the elements of a worthwhile thinking program must be 
enacted in classrooms, it mxxst be obvious that teachers cannot implement 
them unaided. Principals, supervisors, and other administrators must 
assist thi»m in several ways. 

First, administrator must be aware of and informed about the nature 
of each of these approaches and how they can be carried out in the vari- 
ous subject matters. Second, administrators must assist teachers in 
learning and carrying out these approaches in their own classrooms. 

They cim provide this assistance in a variety of ways: by formative 
classroom observation and follow-up analysis with teachers; by assisting 
or arrangijig for specialists to assist in lesson planning, curriculum devel- 
opment, and textbook selection; by organizing and supporting training 
efforts to help teachers learn, practice, and master these approaches; and 
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by secxiring the materials, time, and other resources needed to implement 
and maintain an int^rated program for teaching thinking 

And finally, administrators and supervisors must provide the continu- 
ing support — through resource allocation, training, and evaluation- 
needed to ensure the purposeful and continued use of these approaches 
by all teachers. It takes the leadership and support of prindpals, especial- 
ly, to bring about the kinds of classroom teaching required to develop the 
qxiality of student thinking so much soi^ht after today by employers, imi- 
versity instructors, teachers, and parents. Meeting this challenge is one 
of the most significant opportimities for instructional leadership fadng 
schcK>I leaders today. 
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The Thinking Cycle 

Robert J. Sternberg 

Sometimes we view thinking the way we view Trix cereal, as some- 
thing only for kids. What principal has not observed a teacher trying 
to teach students to think, while at the same time modeling what is not 
thoughtful? One is as likely to convince yoimgstere to stop smoking with 
a cigarette in one's own hand. 

Thinking is for all of us: children, teachers, and administrators. But we 
often feel frustrated in usii^ the models that are out there, because they 
are too abstract, too theoretical, too removed from the everyday experi- 
ences where we actually need to ^hink. I will propose in this chapter a 
model that is concrete and usable in everyday experience. I will describe a 
set of steps that together form the thinking cycle. The steps are easy to 
use, whether one is a student, teacher, or administrator. 

I will illustrate each step of the thinkir^ cycle in some detail with an 
example from school administration. The example could have come from 
anywhere, but I like the school administration example for its practical 
relevance, and because a key principle of teaching for thinking is to illus- 
trate all steps of thinking (»ncretely, in ways that are directly relevant to 
the life of the learner. 

The particular problem illustrated may not be one that a given princi- 
pal is encoimterixig at any given time, but the type of problem almost cer- 
tainly is. I have taken steps to camouflage the identities of those involved, 
other than myself. 

Steps of the Thinking Cycle 

1. Recognize That a Problem Exists 

You cannot solve a problem unless you know that a problem exists. 
Arguably, the hardest step in the thinfcmg cycle is the recognition that 
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one has a pmblenL Few people welcome problems, and many find ways of 
denying their existence — ^ignoring evidence of a problem, reinterpreting 
that evidence, communicating signals that it is not acceptable to talk 
about the proUem, and so on. 

An eflf«rtive administrator must actively search out the problems in his 
or her sch<M)l. Problems do not go away because we ignore them, they 
grow worse. What may have started out as a brush fire can berome a for- 
est fire by the time we admit that we need someone to put it out. 

I worked as a consiiltant with a school whose new principal recognized 
the existence of a problem. (He had already accx)mplished the first step of 
the t hinking cyde.) The problem was that the school seemed dysfunction- 
al, although the prindpal was not sure why. 

Test scores were low and teacher morale was lower; there seemed to be 
no sense of spirit or educational mission on the part of the staff. The prin- 
cipal wanted to turn the school arotmd, and thought that a consultant 
mi^t be able to help him do so. He had the backing of the district oflSce, 
although not of his staff members. 

Anyone who has administered a school knows how much easier it is to 
diagnose what is wrong in someone else's school than in one'« own, 
because people on the inside may have a vested interest in hiding prob- 
lems fit)m the prindpaL Thus, the new prindpal had already taken a sig- 
nificant step in recognizing that something major was wrong, and in 
seeking whatever resotures he could muster to fix it. 

2. Define the Nature of the Problem 

To solve a problem, you need not only recognize that it exists, but you 
must also figure out what it is, A tremendous amoimt of time is wasted 
solving the wrong problem. People are often ready to rush right in and 
put out the fire. But different kinds of fires need different kinds of treat- 
ments to put them out; chemical fires, for example, often respond better 
to certain kinds of chemical agente than they do to water. 

Good admin i s trators spend time to make sure they know just what the 
problem is before th^ try to solve it They save time that might be spent 
on false starts, possibly causing more disruption than originally existed. 

After talking with many people in the school, and brainstorming with 
the staff, we concluded that the problem was in the ^'culture of the 
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schooL" The previous principal, who had held his post for many years, 
was an "act your way into thinking^ administrator. 

He had been lucky. He had manc^ed the schod in quiet times charac- 
terized by absence of conflict among comj^ting groups, and with little 
pressure for the school to be competitive with other schools. 

The new principal realized that the style of the previous principal 
would not work for him. Under a new superintendent, there was now 
great pressure to raise s^ii^ t^ i^xnres, both in comparison with other 
schools in the district, and in comparison with other districts. 

The previous prindpal was gone, but the culture of **acting your way 
into thinking " remained as his I^cy, and it simply wmild not disappear. 
Organizational cultures do not v^hange easily. When people are accus- 
tomed to doing things in a certain way, and have become comfortable 
with that way of doing things, they will hold on. It is what they know, 
and they are afraid to contemplate the strange and often threatening 
imknown. 

We had defined the problem. But what resources could we bring to 
bear to solve it? 

3. Decide upon Resource Allocation 

A routine occurrence in schools is the discovery, after a plan has been 
set in motion, that resources do not exist to fully implement the plan. 
There may not be enough time, or enough money, or enough commit- 
ment. If the available resources are not considered in advance, and in 
partictdar, if the match between resources and the proposed plan is not 
carefully considered in advance, the school can jSnd itself having to aban- 
don a wonderful plan. People who help^ in the plaiming are then frus- 
trated because of the lack of follow-through. 

In the school wnsultation, we knew before acting that we needed to 
know what resources coiild realistically be brought to bear on the prob- 
lem. The prindpal was clearly committed to solving the problem, and was 
willing to dedicate a series of inservic^ sessions to solving it. 

He was convinced that until the culture of the school changed, noth- 
ing else would improve. Even exciting new programs would fSeul, becatise 
no one seemed willing to give the planning time and forethought that 
would be needed to make them work. The principal had the resources, 
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but what would he do with them? He needed a plan. 

4. Formulate a Plan To Salve the Problem 

Once you have defined the problem and the resources available, you 
are ready to contemplate the steps needed to solve it. It is important to 
have some idea of what these st^ are in advance, and to include branch- 
ing strategies that represent potential contingencies. Of course, no one 
can guess in advance all contingencies, but it helps to think about them, 
if only to prepare in advance for the possibilit> that they may arise. 

In the school consultation, it was espedally important to plan the steps 
to take, because the problem itself involved a lack of thoughtftd planning 
on the part of the previous administration, and as a rmilt, for the school 
as a whole. The school had a bad habit; Do, then think. 

We wanted to set a new standard. So we planned a series of iivservice 
meetings at various times that would stx^ for the entire staff the impor- 
tance of planning, vision, and commitment to renewal. With our plan 
ready, we were prepared to act. 

5. Begin Implementation of the Plan 

The best plans are of little use if they are never implemented. In the 
consultation, we proceeded to implement the plan we had constructed. 
We started with inservice sessions and consxiltations with teachers. But 
we also knew that sometimes the best-laid plans do not work out as 
expected. We were ready with the next step in the thinking cycle, 

6. Monitor the Implementation of the Plan 

Many plans are implemented, but few are monitored. Monitoring 
means checking right away to see if things are going the way you had 
hoped they would go, and if not, why not. Moreover, monitoring is some- 
thing that should be systematic and continr al, rather than haphazard 
and infi^equent. You want to keep track of hr.w things are going on a fair- 
ly regular basis. 

Monitoring is especially important in a system as complex as a school, 
because one can hardly expect that any plan will go wiUiout a hitch. For 
example, some staff members may actively support the plan, others may 
ignore it, and still others may actively or passively attempt to sabotage it. 
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In the school consultation, it quickly became apparent that things 
were not going as well as we had hoped. We had underestimated the 
sheer stubbornness of an entrenched schcKiI culture. 

Some teachers felt threatened by the whole enterprise. They had 
become <x)mfortable with a certain way of doing things, and were reluc* 
tant to change. Other teachers felt that ours was an attempt to load them 
down with more responsibilities without more compensation. For them, 
ours WEF a thinly veiled plot to consume even more of their time, and 
they already felt that they were devoting more time than they were being 
compensated for. And still others wanted inservice sessions that wotild 
"^give them something to do Monday morning.'' 

The type of inservice we were talking about did not seem to them to be 
immediately useful. From our perspective, of course, their attitude was 
part of the problem. They wanted activities that were ready to use rather 
than ones that might require planning. It was clear that the school cul- 
ture would not change easily. Monitoring indicated that the plan needed 
revision. 

7. Fine-Tune or Revise the Plan 

Most plans should be fine-timed; many must be revised or reconstitut- 
ed altogether. A plan that is not going well is not necessarily a sign of a 
failure; rather, it is a hopeful sign — that one recognizes just what is not 
working, and why. 

No one can predict in advance all the things that can go wrong, or even 
right, with a plan. What one can do is monitor and revise the plan as 
needed. 

The opposition we were encountering made us realize that we had 
underestimated the amoimt of resistance we would meet. Good ideas do 
not necessarily sell themselves, nor do they necessarily seem like good 
ideas to those whose vested interests are perceived to be threatened. 
There was surface compliance with the plan by most of the staff, but it 
was dear that no enthusiasm existed on their part for the change. 

And now we come to one of the realities of the thinking cycle: Not only 
do we aflTect the contexts in which we work by our plans; they also affect 
us. Stories are supposed to have happy endings. This one did not — at 
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least, not then. Instead of the principal altering the culture of the school, 
he was altered by it. 

As a new principal, he did not want to antagonize staff membera with 
whom he would have to work. Nor did he believe that change coiild be 
imposed upon a staff. Meetings were canceled; implementation plans 
were delayed Eventually I resigned, and the principal did not resist. 

His i^Iution was to make incremental dianges that resj^cted the cul- 
ture of the school His was a solution of sorts, but it was one that became 
the basis for a new problem, or the continuation of an old one. 

8. Recognize Today's Solution as Tomorrow's Problem 

We often think of the thinking in problem solving as a linear process. 
It is not. As the title of this chapter states, it is a cycle. Problems in real- 
life contexts are often difficult to solve. Even when they are solved, we are 
often not quite done with them. 

The solutions to today's problems can become tomorrow's problems. 
Whatever plan one hnplemente, whatever solution one finds, it will ulti- 
mately become the basis for the next problem. 

Problems are the normal state of things. No sooner do we solve one 
than another arises from that solution, no matter how good it may seem 
to be. The problem may be a very different one; it may be less serious or 
more serious. But soon^ or later, new problems will arise. And our abili- 
ty to think and to administer will be tested by our skill in handling the 
new problems as they arise. 

About eight months after my resignation, the principal called me. The 
situation in the school had gotten worse, and he had considered resign- 
ing. But then he decided that he was not going to resign without giving 
things a chance to work. So now we are trying again. 

And here is a curiotis thing: The principal has found that since he 
started taking more <x>ntrol, the reaction of his staff and his superiors in 
the central office has gotten better, not worse. He realizes that they 
sensed weakness and indecision before and exploited it He is now strong 
and decided; people are starting to join rather than fight him. 

Generality of the Thinking Cycle > 

I have illustrated the thttiking cycle in the context of a school administra- 
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tive problem. The utility of the cyde is not limited to ibis kind of problem. 
It applies to any kind of problem, whether for administrators, teachers, or 
students. Consider briefly the kind of problem that might be faced by e 
teacher, and then by a student 

A typical problem fac^ by a teacher is that of the underachieving stu- 
dent. How can the thinking cycle be brought to bear on such a problem? 

The first step in solving the problem is recognizing that there is a prob- 
lem — that the student is an underachiever. The second step is defining 
the problem — ^understanding why miderachievement is occxirring, so that 
something can be done about it Any nimdiber of reasons exist — peer pres- 
sure, conflict or other problems in the home environment lack of parental 
support for school achievement lack of motivation, laziness^ and so on. 

To solve the problem, the teacher must know what is causing it. Third, 
the teacher must <K)ntemplate what r^urces he or she can brii^ to bear 
on the problem: how much time does she have, how much support will 
she get icom the school psychologist or other staff, fix)m parents, and from 
other students? Fourtti, the teacher must formulate a plan for solving the 
problem. If, for example, she attributes the problem to lack of support in 
the home, she will almost certainly want to arrange for one or more par- 
ent-teacher conferences, and possibly for the student to engage in activi- 
ties with adults who have supportive attitudes toward schoolwork. 

Fifth, the teacher must implement the plan; and sixth, monitor that 
implementation. If the teacher has arrange a variety of supports for the 
student ar.d the underachievement continues, he must consider either 
that the cause of the problem was misidentified or that the intervention 
is not suflBdent to change the behavior. 

Seventh, the teacher may have to revise the plan, or fine-time it, per- 
haps adding more supports, or eliminating ones that have not been effec- 
tive. Finally, she will need to prepare for fiiture problems. 

Once the student starts achieving at the level of his ability, he may 
discover pressures that are new to him — for letter grades to be admitted 
to a good college, doubts about whether it is worth it, peer pressure to 
ease up, and so forth. The teacher must be ready for a continxiing cycle 
to deal with new problems as they emei^e. 

Consider next a very different kind of problem: a student is assigned a 
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term paper Schools generally do not allow students to rea^nize problems 
for themselves. Often, they do not even allow them to define the prob- 
lems—they tell them exactiiy what the problems are (e.g., specific test 
questions, or assigned paper topics). In this case, the student knows she 
has a problem, and must define its nature. 

What will the paper treat? The student must decide in advance how 
much time to allocate to it, roughly how much research wiU be needed, 
and so on. She will then ne^ to plan the paper and then start to write it 
She may find tJhat there are not enou^ source on the particular topic, or 
that there are many and that she does not know which ones are worth 
consulting. Or, she may find the topic too broad or t<H> narrow. The stu- 
dent must fine-tune the choice of topic, or the structure of the paper, or 
choose another topic altogether. 

Conclusion 

The thinking needed for successful problem solving is a cycle, not a 
straight line. The end of the cycle brings us back to the beginning, not 
necessarily of the same problem, but to a new problem or set of problems. 

There is nothing magical about being a good thinker. Anyone can apply 
the thinking cycle to his or her advantage. It is simply a matter of decid- 
ing to do so. 



Note: This article was prepared with support from Grant No. R206R(XXM)1, OflSce 
of Educational Research and Improvement, U.S. Department of Education, sup- 
ported under the Javits Act. The findings and opinions expressed in this report do 
not reflect the position or policies of the OHIce of Educational Research and 
Improvement or the U.S. Itepartment of Education 
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James W. Keefe 

Teaching for thinking is an important trend. It is not a new move- 
ment, as Francis Schrag points ont in Chapter 3, but it is gaining in 
momentum. It is also splintered by two broad perspectives, many 
approaches, and a lack agreement about the relationship between 
basic information proc^sing skills and hi^er order thinking skills. 

In his introduction^ Herbert Walberg cited the need to strike a bal- 
ance among the differing, often opposing, views of teaching for thinking. 
Barbara Presseisen defined the terms — cognition, metacognition* moti- 
vation, content — and the terms of disagreement — content-free approach- 
es versus content-embedded approaches. Robert Maraano further delin- 
eated the domains — ^learning to learn, content thinking, and reasoning. 

Several of the authors dismissed successful instructional and assess- 
ment techniques. Cognitive scaffolds, reflective teaching, cognitive assess- 
ment and augmentation, cognitive-based instruction, and performance 
testing— all facilitate teaching for thinking- Barry Beyer summed it up by 
urging a comprehensive program across the curriculum, and Robert 
Sternberg demonstrated the generality of the thinking cycle. 

Teaching for thinking can work, then, but teachers and administra- 
tors must thoughtfully sort out the ambiguities. 

Human Infom^ation Processiiig 

Too many students, as Charles Letteri laments, seem to come to school 
for the first day, each day. Some students think and perform well outside 
school, yet do poorly in academic subjects. Others exhibit intelligence 
and the ability to think creatively, but cannot complete daily assign- 
ments or participate snccessfuUy in classroom activities. Still others do 
well in ordinary schoolwork but seem unable to engage in higher order 
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thinking. The following continuum of skills or capabilities is implied in 
these common student behaviors. 



Continuum of Information Processing Skills 

Cognftive Learning To Cont^ Refl«rtlve 
Controls Leam Thinking Reasoning 



Basic Higher 



This continuum flows from basic thinking skills (e.g., analysis, catego- 
rizing, sequential and simultaneous processing) through learning-to- 
learn (self-management) strategies and content-based thinking, to high- 
er order forms (e.g.^ extrapolation, evaluation, critical thinking, creative 
thinking). 

Students may, and probably do, have skills at many places on the 
continuuim. A particular learner, for example, may have strong analytic 
skills but weak simultaneous processing (visuo-spatial/relational) skills 
at the cognitive control level, average leaming-to-leam skills, poor to 
fair understanding of various subject contents, and good critical think- 
ing or everyday thinking capabilities. (Everyday thinking is complex 
and higher order.) The strong analjrtic skills at the lower order level 
support and make possible the strengths at the higher levels. 

On the other hand, weaknesses at the lower levels can lead to weak- 
nesses at other points in the continuum. Simultaneous processing 
weakness, for example, can inhibit learning in various content areas 
(e.g., vocational arts, science) and reduce effectiveness in analogic rea- 
soning (higher order). Weak leaming-to-leam management can cripple 
content thinking and restrict higher order thinking. 

If we add the four aspects of thinking suggested by Barbara Pres- 
seisen in Chapter 1 to our continuimi, we have a simple matrix for think- 
ing about thinking and the thinking movement (See Figure 1), 
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Rgure 1. Thinfdng Matrix 



Levels: 



Cognitive 
Controls 



Learning 
To Learn 



Content 
Thinking 



Reflectiv^ 
Reasonin 



Aspects 
Cognition 


1 


5 


9 


13} 1 

■ 

• i 

r. 


Metacognttfon 


2 


6 


10 


14 ^ \ 

.X ■ 


Motivation 


3 


7 


11 


16 


Content 
Structure 


4 


8 


12 


16 



Elements of the Thinking Matrix 

In recent years, many psychologists have come to view the brain as a 
very complex system for processing and storing information (Travers, 
1982). This conceptualization of human learning as information pro- 
cessing, storage, and use can be very meaningful to educators. The view 
has been well received in higher education, but as yet has not much 
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influenced elementary and secondary schooling, which still largely 
emphasize behaviorist approaches. 

Most educators view ihe acxjuisition of ^ential knowledge and skills 
as the primary purpose of schwlic^. Research on information processing 
sheds a great deal of light on how knowledge is u'^quired, stored, and 
recalled The process by which the brain systematically coll^rts infonna- 
tion is known as perception. Perception^ in turn, is related to memory — 
both storage and recall — and to how each hnman being develops, orga- 
nizes kaowledge, and uses l an g uage. 

In Chapter 6, Letteri pointed out that learning is not automatic; it 
requires sustained and directs! eflfort. In Letteri's view (1991), all content 
(subject matter) is info^ination, and must pass through the individual's 
information processus system to be learned, retained, and recalled. After 
information is re<«ived from the external environment through the senses 
and stored briefly in perraptual memory, the mind makes a decision what 
to do about a message. 

It may reject the information, memorize it for short-term recaU, trans- 
form it to conform to prior messages, or learn it by integrating, assimilat- 
ing, differentiating, or associating it in working and long-term memory. 
Real learning occurs only when the information becomes a part of long- 
term memory — the individual's cognitive structure is changed. {Memoriz- 
ing is not the same as learning.) 

Effecti veness in thinking is dependent on skill and rontrol in informa- 
tion processing- Effective learning and thinking walk hand in hand. The 
Thinking Matrix profiles the nature of this relationship in terms of eight 
elements. 

Levels of Thinking 

■ The most basic capabilities of the information processing system are 
called cognitive controls. For learning to occur, the student must 
possess the needed cognitive skills and structures. Most learning 
problems are related to specific cognitive skill deficiencies. Fortunate- 
ly, the cognitive skills (controls) can t« improved through training so 
that virtually every learner can use (and direct) the various opera- 
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tions of learning and thinking. Students improve in all learning and 
thjnlring by improving their skills of analysis, selective attention, cat- 
prizing, memory, etc. 

■ Lreaming-to-leam strategies are ways that students regulate their 
iaformation processing. As rognitive control skills are developed, the 
key to higher levels of thinking is consistent management of these 
basic skills—controlling the controls- Students learn how to learn in 
dififerent content areas and iinder differing learning conditions- They 
develop skills in transfer— the capability of using knowledge and skills 
in similar but unfamiliar areas. 

■ Content thinking involves using cognitive control and management 
skills in combination to process subject matter content Such skills as 
concept attainment and development, pattern recognition, and syn- 
thesizing enable learners to understand and learn new concepts and 
to (X)mprehend, or^nize, and integrate new bodies of knowledge. 

■ Reflective reasoning moves beyond simple rules, relationships, and 
principles to higher frameworks of meaning — anal<^, extrapolation, 
evaluation, elaboration, invention. Reasoning skills enable learners 
to use information to restructure their imderstanding of various bod- 
ies of content. Reasoning is the end product of himian information 
processing — ^using knowledge to create new and more complex cogni- 
tive structures. 

Aspects of ThmkiTig 

■ Cognition describes the cognitive process itself, the mental acts 
whereby knowledge is acquired and integrated into an individual's 
cognitive structure Gong-term memory). Cognition entails perceiving, 
learning, thinking, problem solving, and remembering. It involves dif- 
ferent manifestations of intelligence — from verbal and academic abili- 
ties, to artistic talents, to social skills. 

■ Metacognition is the learner's recognition and regulation of his or 
her ovra processes of thinking, Metacognitive skill means that the 
learner recognizes how and with what degree of capability he or she 
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processes information and is willing to manage and improve it. 
Metacognition is often called the executive skill, because it implies 
that the learner has taken charge of his or her own thinking. 

■ Motivation (or agnation) encompasses the attitudinal and emotional 
aspects of learning. Students learn more readily and better if they like 
what they a3re leamix^. Bloom (1976) has pointed out that students 
are variously motivated to learn depending on whether they like 
school, the subject, the teacher, and whether they have previously 
been miccessful in a given area of leamii^. 

■ Content structure involves epistemolqgical ojnsiderations: how a par- 
ticular subject content influences what is learned; how knowledge is 
classified; the methods used to define content; and the findings of 
mature scholars that students rnxist know and use to attain their own, 
more limited mastery. Transfer of knowledge and skills is at the heart 
of this aspect of thinking. 

Keeping in mind the meaning of the various elements of the Think- 
ing Matrix, it is fairly easy to classify the contaibutions of our authors. 
Thoughtful lessons (Chapter 3) are content thinking that emphasizes 
motivation and the structure of the experience (cells 11 and 12 of the 
matrix)- Scaffolds (Chapter 4) facilitate the presentation of content, 
guided student p* ^ctice, and feedback to students. They lie in the mid- 
dle of the matrix, consisting of learning- to*leam and content thinking 
strategies that affect all aspects of thinking (cells 5 to 12 of the 
matrix). 

Reciprocal teaching (Chapter 5) can involve any of the cells of the 
matrix beyond cognitive controls. Like scaffolds, it is primarily concerned 
^vith the leaming-to-leam and content thinking dimensions. Cognitive 
augmentation and transfer and cognitive-based instruction (Chapter 6) 
are concerned with c<^nitive control, leaming-to-leam skills, and content 
skills in all aspects of thinking (cdls 1 to 12). 

The integrated approach to thinking proposed by Barry Beyer (Chap- 
ter 8) can range across the entire matrix if it is implemented in a com- 
prehensive manner. Robert Sternberg's "thinking cycle** (Chapter 9) is. 
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in the final analysis, a plea for using such a comprehensive plan. 
The Thinking Movement 

In recent years, many people have daim^ that American students can- 
not think effectively. A whole array of re{K>rts, books, and articles has 
been written supporting or describmg pn^rams aboMt thinking. Many of 
these publications mention students' inability to perform comple:s aca- 
demic tasks or to answer h^^iar oixder qu^tions. Hie blame is imputed to 
too much group-oriented instruction, too littie t^u±er-student-i^^ inter- 
action, and the tetxtbook-to-test teachix^ methodol<^ <tf most da^arooms. 

Contemporary approaches to the teaching of thinking iise such terms 
as critical and creative thinking, thinkin^T processes and skills, metao^- 
nitive and memory strat^es. In general, all th^ labels define capabili* 
ties that enable individual students to manipulate knowledge and experi- 
ence in usefiil and adaptive ways. 

Thinking processes, for example, indude concept and prindple forma- 
tion, comprehension, problem solving and decision making, research and 
composition skills, and the skills of verbal interaction. 

Thinking skills exist more at the micro level. (Processes are more com* 
plex than skills.) Skills are the building blocks of thinking, such as focus- 
ing and defining, gathering information, remembering, organizing and 
analyzing, generating and int^rating new information^ etc 

Many of these terms are no more than ^monyms for various phases of 
the human information processing ^tem. Processes such as attention, 
perception, and memory; and operations such as integration, differentia- 
tion, assodation, and retrieval are internal to the systemu Any discussion 
of improved thinking necessarily implies an understanding and applica- 
tion of information processing theory. The \iltimate success of the think- 
ing skills movement, then, will depend almost entirely on the acceptance 
of an information processing approach to school learning and instruction. 

Albert Benderson (1990), in a recent Educational Testing Service pub- 
lication, Critical Thinking: Critical Issues, dtes the rift that divides 
experts in the field as the prindpal obstade to pn^ress. He comments: 

Both philosophers and psychologists have come to view the teaching of thinking 
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as their own special skill, but their perspectives are intrinsic^y different .... 
Philosopl^rs staness the need for **aitical thinking,'* while psychologists prefer 

tho term 'thinking skills^ In the^ variations on a thenae, the philosophers 

str^ logic and cAjjective reasonirg as the core of critical thinking. The psycbol- 
ogists take a different tack, focusing on the process of thinking itself .... 
Philosophers are l^mcally intffi'ested in tl^ eserdse of logic and reason as tools 
to elucidate certain fbndamental truths .... The programs th^ recommend for 
the schools mpbasi% the development of rational thinking as a tool far making 
moral and ethical decisions .... Rsychdc^ists, on the other hand, ane conmned 
with the thinking process, and, with respect to education, how that process 
develops as children grow .... Problem sdvii^ is emphasized rather than logic 

We can say isimilar things about the rift within psychology itself. Some 
psychologists concentrate on the thinking process itself, and the skills 
and strategies needed to make it work. Others fcKnxs on problem solving 
as the end proj^rt — ^the higher end of our thinking continuum. 

Those who emphasize the process are concerned witii ct^pitive controls 
and leaming-to-leam strategies. Those who favor the higher end of the 
continuum ignore cognitive controls (some seem not to know they exist) 
and emphasize the need for higher order skills in life and work. 

Of course, everyone is rig^t. With the psychologists, we affirm the need 
for both essential information processing skills and higher order problem- 
solving skills. With the philosophers, we support critical, rational, and 
reflective reasoning. 

We would emphasize, however, the importance of essential skills for 
school-based learning, the critical need for leaming-to-leam skills in both 
school and life, and the developmental nature of human information pro- 
cessing. Students need some essential skills to engage in any higher order 
thinking. 

For truly effective critical and reflective thinking, they need sophisti- 
cated control of all essential processing and adequate content knowledge. 
In terms of our continuimi, they must have functional skills at the lower 
levels to achieve consistent skill at the upper levels. 

The cognitive trend is probably sufficiently established in contempo- 
rary thinking about human intelligence and cognitive/learning style that 
it will have a significant influence on the way instruction is planned and 
delivered. We may have to wait until the next decade or later for any rec- 
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ognizable change in the instructional system itself^ but cognitxye style 
assessment is already well on the way to becomiog a regular dement in 
instructional diagnosis, and higher order thinking proposals dominate 
the educational poUQr agenda. 

There is a Chinese proverb that says a journey of 1,000 miles begins 
with the first step. Our next step is to firmly groimd our applications of 
schooling in cc^nitive sdenoe — in a waiting knowl^lge of the htnnan infor- 
mation processing system. Educators must know emni^ about tl^ process 
of learning and thinking to teach students how to learn and to think We 
miist come to understand and to involve students in understanding and 
using their «>gnitive controls and the powerful higher order strategies for 
Improvir^ their storage, retrieval, and manipulation of information 

Specifically: 

1. We must train cognitive specialists (much like our current reading spe- 
cialists) who will serve as resource teachers, helping classroom teachers 
identify and enhance the cognitive skills of learners. These specialists 
must be expert not only in first-level cogxiitive skill assessment, with 
instruments Uke the NASSP Learning Style Profile, (Keefe et al., 1986, 
1989), but be capable of designing augmentation programs for students 
with cognitive skill deficiencies. (Colleges and universities will need to 
develop programs to prepare these specialists.) 

2. We must also develop curricula for the major sutgect fields that are sen- 
sitive to the levels of cognitive skill in individual learners and attempt to 
elicit higher order thinking in the various content domains. Practically 
speaking, this means designing curricula that use strategies like scaffolds, 
schemas, semantic maps, and cognitive networks to help students learn 
and think in meaningful and clearly organized ways. Textbook publishers 
will need to collaborate both with content authors and cognitive specialists 
if this goal is to be realized 

Teaching for thinking is a realizable goal. The thinking movement may 
well be the integrating fon^ that pulls together policy makers, education- 
al practitioners, researchers, parents, and students to really restructure 
our schools. If this happens, schools may yet become thinking places 
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where students learn to love learning and prepare themselves for tnily 
thoughtful lives. 
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